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ABSTRACT  V 

The  final  report  of  the  project  that  concentrated  on 
the  expository  language  found  in  cpn tent-area  textbooks  begins  with 
an  overview  o£  the  project,  including  rationale ,  significance,  and 
goals.  These  goals  were  to  (1)  describe  how  high  school  stude^nts  and  ' 
their  teachers  used  their  textbooks,   (2)  describe  and  analyze  the 
nature,  of  expository  texts,   (3)  examine  the  influence  of  r 
characteristics  of  expository  texts  upon  different  readers*  memory 
for  text,   (4)  determine  the  influence  of  various  instructional 
procedures  upon  students*  ability  to  learn  from^ text ,  and  (5)  examine 
the  inflJUence  of  text  manipulations  upon  the  quality  of  students' 
learning  from  text.  The  remain ijig  sections  of  the  report  address  the 
secondary  students*  use  of  biology ^and  history  textbooks;  describe 
the  characteristics  of  texts,  especially  through  their  language; 
discuss  text  analytic  procedures  (validation  and  criticism);  define 
reader  characteristics;  examine  text-based  instructional  studies;  and 
discuss  text  engineering.  The  summation  of  the  project  is  provided  in 
the  final  section.  Appendixes  include  the  surveys  administered  to 
students  in  Illinois  and  Texas;  tables  relevant  to  secondary 
students'  use  of  biology  and  history  textbooks;  a  complete  set  of 
tayts,  maps,  and  lists  of  relationship  propositions^^ 
scoring  and  rationale  fOr  scoring  two  free  recall 'prdtocols;  tables 
relevant  to  students ;  srecall        text  units;,,,  individual  subjects' 
ratings  of  the  ease  ofXresolut ion  and  the  importance  of  cohesive 
ti^s;  graphs  of  predictability  ratings  of  topic  continuity;  and  the 
importance  of  rating  seirtences.  (HOD) 
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RATIONALE,  SIGNIFICANCE  AND  GOALS 
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In  a  typical  school  setting,  particularly  at  the  secondary 
level,  the  language  students  must  deal  with      the  language  of 
exposition,    "discourse  Resigned  to  convey  Information  or  explain 
what  Is  difficult  to  understand"  (Webster's  Dictionary).  Some 
characteristics  of  that  discourse  Is  that  In  comparison  to  Inter- 
personal language,  expository  discourse  Is  more  formal,  more  logical, 
less  engaging,  less  familiar.  In  short,  more  difficult.    In  addition 
to  these  surface  differences,  expository  discourse  brings  with  It 
a  functional  difference.    The  student  (or  general  reader/listener) 
engaged  In  expository  discourse  Is  being  Invited  not  only  to 
understand  the  language  presented  but  also  to  change  his/her 
existing  knowledge  about  the  world.    This  additional  task  requirement 
means  that  encounters  with  expository  discourse  will  naturally  be 
effortful  and  fraught  with  the  possibility  of  being  unsuccessful. 

In  this  project,  we  concentrated  on  the  expository  language 
found  In  content-area  textbooks.    Our  general  goal  was  to  Investi- 
gate the  nature  of  naturally-occurring  textbook  language  and  to 
describe  how  students  approach  and  learn  from  their  textbooks.  In 
surveying  the  psychological  and  educational  literature  on  the 
learning  process,  we  were  struck  by  how  little  was  known  about 
what  students,  particularly  at  grades  below  college  level,  actually 
did, when  encountering  their  own  textbooks  within  a  natural  Instruc- 
tional setting.    Therefore,  we  deemed  it  valuable  to  study  the 
expository  discourse  found  In  secondary  level ,  content-area  text- 
books and  to  measure  how  students  approached  their  textbook^  and 
what  they  learned  from  them.    We  pursued  this  general  goal  by 
means  of  attacking  several  Interrelated  sub-goals  that  we  describe 
shortly. 

Before  turning  to  the  specific  purposes  that  guided  our 
Investigations,  we  need  to  describe  some  practical  features  of  our 
study  that  Influenced  how  we  proceeded.    First,  the  project  was 
conducted  from  two  sites:  Austin,  Texas,  and  Champaign,  Illinois. 
This  division  was  an  unplanned  and  In  some  ways  unfortunate 
circumstance   In  that  the  benefits  of  having  two  Investigators 
Involved  were  mitigated  by  distance.    However,  we  found  that  there 
were  numerous  benefits  as  well  from  the  division  of  labor. 


ERIC 


Much  of  our  data  reflects  the  performance  of  a  wider  population  than 
would  otherwise  have  existed.   Colleagues  in  different  locales 
contributed  different  perspectives.    In  addition,  we  found  that  we 
pursued  different  extensions  at  the  different  sites  af  the  original 
studies  planned.    Thus,  what  began  as  a  four-^periirtsnt  study  ended 
up  as  a  twelve-experiment  project  along  with  the  development  of  an 
original  text  analysis  tool  ,  a  survey  questionnaire',  and  two 
critical  papers  on  related  topics. 

Secondly,  we  began  with  a  relatively  strong  interest  in 
describins  different  reader  characteristics  that  might  influence 
how  students  perform  on  measures  of  their  textbook  learning.  Thus, 
initially  we  planned  to  focus  much  of  our  description  in  terms  of 
Utudent  cfiaracteristics  such  as  gender,  course  en rpl led  in  and 
self-evaluation  of  learning.   As  the  project  developed,  we  found 
ourselves  increasingly  focused  on  describing  text  features  that 
make  a  difference  in  students'  responses.    Thus,  we  found  that, 
for  example,  authors  are  often  indirect  in  showing,  the  connection 
between  main  topics  and  supporting  detail  and  whenever  they  are 
implicit,  students  as  a  group  find  it  difficult  to  learn  from  the 
discourse.    Also,  we  generally  found  that  reader  characteristics, 
as  we  defined  and  investigated  them,  did  not  make  an  impor'tant. 
difference  in  how  we  described  how  students  learn  from  expository 
discourse. 

It  is  important  to  add  that  our  shift  in  focus  was  a  relative 
one.    We  never  abandoned  reader  characteristics.    Rather,  we  simply 
found  our  interest  piqued  by  what  textbook  authors  seemed  to  be 
doing  with  their  prose  and  our  data  from  text  investigations  more 
systematic,  reliable  and  therefore,  potentially  useful. 

In  what  follows,  we  describfe  the  specific  goals  that  guided 
our  investigations  along  with  some  of  the  relevant  background 
literature. 

The  first  goal   was  to  describe  how  high  school  students  and 
their  teachers  use  their  textbooks.    The  study  of  how  high  school 
students  and  teachers  actually  perceive  and  use  their  textbooks 
is  important  not  only  as  a  preliminary  to  describing  texts,  but 
also  as  a' goal  in  its  own  right.   Recognizing  that  little  is 
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known  about  the  specifics  of  textbook  use,  ai\d  that  out  Initial 
contact  with  students  and  their  teachers  could  economically  yield 
such  Information,  we  decided  to  pursue  a  description  of  the 
following:    (1)  methods  of  study  students  use  when  reading  their 
textbooks;  (2)  aspects  of  textbooks  which  make  It  difficult  for  . 
students  to  understand  what  they  read;  (3)  difficulties  students 
encounter  when  studying  from  a  textbook;  and  (4)  teacher  assistance 
In  the  use  of  textbooks  that  students  find  beneficial . 

A  review  of  literature  dealing  with  secondary  reading  suggested 
that  accounts  of  textbook  use  In  high  school  classes  were  largely 
anecdotal .    It  was  our  sense  that  how  students  and  teachers  use  and 
perceive  the  adequacy  of  textbooks  and  Instruction  In  textbook  use, 
as  well  as  the  ability  to  learn  from  text  had  been  examined  to  some 
extent,  though  not  systematically  and  primarily  at  the  college 
level. 

Our^ursult  of  this  first  goal  Is  presented  In  Section  II. 
Note  that'V  had  not  figured  In  our  original  plans  but  emerged  as 
we  consldajred  ouMnltial  contacts  with  high  school  teachers  and 
students. 

The  second  goal  was  to  describe  and  analyze  the  nature  of  ^ 
expository  texts.    Current  literature  In  the  fields  of  cognitive 
psychology  and  linguistics  offers  a  number  of  system^  for 
analyzing  text,  for  categorizing  text  characteristics,  and  for 
representing  learner-s  memorial  representations  of  text  (Crothers, 
1972;  Frederlksen,  1972,  1975;  Meyer,  1975,  1977;  Kintsch,  1974, 
1977;  Kintsch  and  van  Dijk,  1978;  Grimes,  1972;  Hal  11  day  &  Hassan, 
1976).    Many  features  of  these  theories  and  systems  could  lend 
themselves  quite  well  to  a  description  of  expository  text  especially 
In  terms  of  propostlons,  Interproposltlonal  connectors  and 
cohesive  ties.    In  other  words,  the  systems  might  describe  loc^l, 
on-l1ne  comprehension  requirements  of  exposition.    Where  we  see  a 
Tack  of  development  and  guidance  from  the  existing  literature  Is 
In  the  area  of  the  overall  logical  pattern  of  the  Ideas  stated 
either  explicitly  or  Implicitly  by  an  author  with  the  expectation 
that  the  reader  will  learn  these  Ideas.    The  kinds  of  structures  we 
seek  to  describe  come  closest  to  what  rhetoricians  and  experts 


In  technical  writing  h^ve  discussed,   ite  contend  that  expository'' 
text  Involves  the  presentation  of  key  relationships  between  concepts 
and  that  the  nature  of  a  learner's  undejs^stahding  Involves  In  some 
Integral  way  the  representation  of  these  relationships. 

Most  of  the  developed  systems  oftext  analysis  have  attempted 
to  provide  a  general  description  of  extended  pieces  of  text.  However, 
we  saw  a  need  for  analyses  that  went  beyond  propositions,  Inter- 
proposltlonal  connectors,  and  cohesive  ties,  and  that  attempted  to 
represent  differentially  the  structural  and  logical  relationships 
Inherent  In  ejiposltory  text.    Thus,  our  second  goal  was  to  analyze 
the  characteristics  of  textbook  samples  to  determine  those  features 
, that  would  make  the  texts  easy  and  difficult  to  learn.    Section  III 
and  IV  of  this  report  address  this  goal. 

A  third  goal  of  the  proposed  study  was  to  examine  the  Influence 
of     characteristics  of  expository  texts  upon  different  readers' 
memory  for  text.    By  comparing  the  analyses  of  text  described  under 
Goal  2  with  subjects*  memory  for  the  same  texts,  we  expected  to 
obtain  a  clearer  understanding  of  the  nature  of  reader/text  Inter- 
actions across  expository  selections.    We  were  guided  by  previous 
research  suggesting  that  certain  aspects  of  text  structure  do 
Influence  the  amount  and  type  of  Information  recalled  and  that 
predictions  can  be  made  based  upon  text  featur^as  to  where 
Inferences  such  as  distortions,  omissions,  and  additions  will  occur. 
The  greater  part  of  this  work  has  Involved  the  analysis  of 
narrative  text.    Rumelhart  (1975),  Kintsch  (1976),  Thorndyke  (1977), 
Mandler  and  Johnson  (1977),  and  Chodos  and  Mdsenthal  (1978)  among 
others  have  demonstrated  the  Influences  upon  recall  of  a  generalized 
simple  st^ory  structure  that  most  readers,  even  rather  young  ones, 
'<         possess.    Based  upon  an  analysis  of  a  text  In  terms  of  the  story 

schema,  predltlons  were  made* and  validated  as  to  where  omissions  and 
distortions  might  occur.    With  expository  text,  Meyer  and  McConkle 
,    (1973),  Meyer  (1975,  1978)  and  McKoon  (1977)  have  shown  the 

Influence  of  the  hierarchy  and  Importance  of  Ideas  within  text  upon 
recall.    Clements  (1975)  demonstrated  the  Influence  of  the  staging 
of  Ideas.    Marshall  (1976)  and  Tierney,  Bridge  and  Cera  (1979) 
have  demonstrated  the  influence  of  the  proposltlonal  content  and 


interpropos1t1ona1  rielatlonshlps.    In  the  present  Investigation 
the  various  text  characteristics  derived  from  our  system  ,of  text 
analysis  became  the  focus  of  bur  predictions .    The  primary 
discussion  relevant  to  thls^al  can  be  found  In  Section  III. 3. 

A  subgoal  relevant  to  examining  the  Influence  of  text  charac- 
teristics upon  a  reader's  memory  was  to  consider  how  certain  reader 
characteristics  might  act  as  covariates.    The  reader  characteristics 
selected  were  metacognitive  ratings,  including  gender  of  the 
subjects  and  the  subjects'  field  of  study  (Biology  vs.  History).* 

With  respect  to-if5etacognit ion,  there  seemed  to  be  little" 
empirical  data  on  the  nature  of  a  reader's  metamemory  for  expository 
-*4|Jections  except  to  say  that  readers  often  overestimate  their 
level  of  understanding  and  are  i/Bware  of  strategies  they  might  use  to 
cope  with  difficulties  they  incur.    As- Flavell  and  Wellman  (1977) 
and  Brown  and  Campione  (1977)'^s^ate,  students  seem  remarkably 
uninformed  about  their  level  of  understanding,  including  their 
strengths  and  weaknesses  as  students. 

Our  interest  in  examining  the  relationship  of  the  subjects' 
gender  and  field  of  study  to  ability  to  learn  from  textbook 
discourse  was  tied  to  the  popular  belief  that  women  students  show  / 
a  definite  tendericy  to  avoid  and  to  do  poorly  in  the  "hard"  ^ 
sciences  (those  involving  a  substantial  amount  of  mathematics)  and 
that  very  few  women  enter  scientific  careers.    Certainly,  it  has 
been  found  that  women  as  a  group  perform  more  poorly  than  their 
make  counterparts  in  science  and  mathematics  while  performing 
better  than  men  in  reading  (Johnson,  1974).    Wit)rThese  findings 
and  beliefs  in  mind,  we  were  interested  in  examining  the  data  from 
two  fields  of  study  keeping  in  mind  the  subject's  sex.    To  this 
end,  we  selected  a  life  science  (Biology)  and  a  social  science 
(History)  as  dortiafns  for  the  pursuit  of  our  study.    A  discussion 
relevant  to  this  goal  can  be  found  in  Section  V. 

A  fourth  goal  of  the  present  project  was  to  det^ine  the 
influence  of  various  instructional  procedures  upon  students' 
ability  to  learn  from  text.    With  this  in  view,  two  instructional 
studies  were  pursued.    A  study  we  conducted  with  our  associates, 
E.T.  Goetz  and  M.C.  Murphy  examined  the  effectiveness  of  a 
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procedure  Involving  mapping  as-a  study  strategy.   The  technique 
was  based  partly  &f\  the  work  of  Merritt  and  his  colleagues 
^  (Merritt,  Prior  and  Grudgeon,  1977)  and  developed  In  conjunction 
with  a  team  headed  by  Thomas  H.  Anderson  of  the  Center  for  the 
Study  of  Reading  in  IllWij.^  It  Incorporates  symbols  used  in  ^ 
other  well-known  schemes  such  as  Venn  diagrams,  double-entry 
tables,  outlines,  and  flow  charts.    Simply  described,  the  process 
of  mapping  a"^text  involve^  identifying  they^ssence  of  the  message 
of  the  author  and  representing  these  Ideas  symbolical ly  to  show 
their  complex  Interrelationship.    The  syst^.  as  a  study  aid.  Is 
meant  tP  summarize  visually  the  overall  organization  of  Ideas  In 
text.*  A  second  study,  by  Margolis,  examined  the  effectiveness 
of  a  strategy  directed  at  helping  students  Identify  and  organize 
topics  and  subtopics.    The  topic/subtopic  strategy  j^as  a  two-step 
procedure  designed  to  enable 'readers  to  recognize  relationships 
among  key  Ideas  in  text.    Both  the  mapping  and  topic/subtopic 
strategy  were  tied  directly  to  the  methods  of  analysis  used  to 
identify  text  characteristics  referred  to  under  our  second  goal. 

^aken  together,  the  results  of  these  studies  were  Intended 
to  provide  suggestions  for  how  teachers  might  help  students  make 
more  profitable  use  of  their  testbooks.    In  particular,  based  upoxi 
the  work  of^Armbruster.and  Anderson  (1970),  Geva  (1981),  Long, 
Hein,  and  Coggiola  (1978),  we  hoped  to  examine  the, value  of  study  . 
techniques  requiring  students  to  address  the  jrelatlonshlps  between 
Ideas.    Oi^r  attempts  are  reported  In  Section  VI. 

A  fifth  and  final  goal  was  to  examine  the  Influence  of  text 
manipulations  upon  the  quality  of  students'  learnind  from  text, 
^orollary  to  determining  the  Influence  of  study  skills  Instruc- 
,t1on  upon  students'  ability  to  learn  from  text  Is  the  notion  that 
text  manipulations  might  significantly  facilitate  students'  access 
to  text.    Although  numerous  suggestions  have  been  made  for  purposes 
of  Improving  the  readability  of  text,  very  few  of  thes«  are  based  >^ 
upon  a  systematic  examination  of  the  Influence  of  text  character- 
istics.   Fewer  still  are  based  upon  actual  tests  of  the  Influence 
of  text  manipulations  that  Implement  these  suggestions.  Therefore, 
the  value  of  most  guidelines  for  writing  or  revising  text  are 
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usually  unsubstantiated  and  open  to  question.  ^ 

In  an  effort  to  offer  more  Informed,  suggestions ,  we  declied 
to  examine  the  influence  of  systematic  variation  of  sejected  text 
characteristics.    In  one  study,  we  varied  the  use  of  connectives  and 
the  pattern  In  which  Ideas  were  presented  In  a  text^  form  that  was 
distinctive  In  both  science  and  soclaj^sclence  textbooks.    In  a 
second  study,  the  notion  of 'an  Ideal  text  as  contrasted  with  the 
real  or  original  text  was  pursued.    Based  upon  the  maps  derived 
from  each  text.  Ideal  texts  were  developed  and  their  effect  upon 
recall  was  compared  witfi  that  of  the  real  oie  original  texts. 
From  these  studies,  we  did  not  expect  the  emelsience  of  precise 
guidelines  for  textbook  developers,  .Rather,  we  hoped  to  be  able 
to  make  some  broad  suggestions  for  Imprqving  ^he  learnabll It^y  of 
texts  as  we  advanced  resear^Ji^  on  text  engineering.    The  discussion 
tf  our  attempts  to  meet  this  final  goal^'^f^ears  In  Section  VII. 
Summary  of  Project  Goals 

1.  To  describe  how  high  school  students  and  teachers 
perceive  and  use  their  textbooks. 

2.  To  define  the  characteristics  of  expository  text 
language  In  diverse  fields  of  study. 

3.  To  examine  the  interaction  of  text  characteristics 
with  reader  characteristics  as  students ^earn  from  tD^. 

'    4*.    To  determine  the  Influence  of  Instructional  procedures 
URon  students;  ability  to  learn  from  text. 

5.    To  determine  the  Influence  of  text  manipulations  upon 

the  quality  of  what  students  learn  frdm  text.  v 

\  .  ■  * 

\  ■ 


II 


SECONDARY  STUDENTS'  USE  OF  SOCIAL  STUDIES 
AND  BIOLOGY  TEXTBOOKS 


(with  J.  LaZansky) 
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i  The  study  of  how  textbooks  are  read  and  previewed  by  students 
and  their  teachers  is  important  not  only  as  a  preliminary  to 
describing  texts,  but  also  as  a  goal  in  its  right.    This  section 
of  the  report  describes  how  teachers  and  students  from  different 
parts  of  the  country  use  and  perceive  their  textbooks.  ,  In 
particular,  the  perceptions  of  students  and  , teachers  toward  the 
following  are  described:    (a)  methodic -of  study  students  use  when 
reading  their  textbooks;  (b)  aspects  of  textbooks  which  make  it 
difficult  for  students  to  understand  what  they  read;  (c)  diffi- 
culties  students  encounter  when  studying  from  a  textbook; 
(d)  teacher  assistance  as  it  relates  to  textbook  use.  - 

The  major  assessment  tool  was  the  implementation  of  a 
questionnaire.   The  students  were  asked  to  respond  to  the 
questionnaire  in  a  self-evaluation  mode.    The  teachers  of  the 
students  were  asked  to  complete  the  questionnaire  by  estimating 
a  typical  student's  response  to  each  item. 

Method 

Subjects 

Table  2.1  describes  the  initial  samples  of  students  who  partict 
pated  in  terms  of  their  teacher,  school ,  subject  matter,  and  number 
of  class  sections.    Subsequent  to  thi^s  Initial  sampling,  surveys  were 
completed  in  Massachusetts  and  other  schools  in  Illinais  with  very 
similar  results  to  the  ones  reported  hi^e.  j 

In  Texas  the  survey" was  ifdministered  to  three  tenth  grade 
Biology  classes  and  two  American  History  classes  in  the  same  high 
school.    Two-hundred  five  Biology  students  and  71  History  students 
completed  the  survey.    The  school  serves  primarily  an  upper- 
middle  cliass  section  of  Austin  whose  residents  include  manyV 
university  professors  and  other  professionals^.    In  addition,  \5% 
to  25%  of  those  students  in  attendance  are  from  a  more  rural , 
less  well-off  area. 

In  li  1  inois  the  survey  was  administered  to  143  Biology 
students  and  204  History  students  at  four  different  high  schools, 
each  located  in  a  different  Central  Illinois  community  bi^t  all 
within  a  fifty  mile  radius  of  the  University  of  Ilrinois.  v.. 
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TABLE  2.1 

/  Characteristics  of  CI assroomsv Surveyed 

Illinois  °. 


Teacher 

School 

Subject 
Matter 

Number  of 
Sections 

Teacher  1 

School  A 

Biology  1 

4 

Teacher  2 

School  B 

Biology  1 

3 

Teacher  3 
Teacher  4 
Teacher  5 

School  C 

Advanced 
Biology 

American 
History  . 

Advanced 
Biology 

American 
History 

1 

■  'V 

1 
1 

Teacher  6 

Sphool  D 

American 
History 

5 

Texas 

Teacher  1 

10th  grade 
Biology 

Teacher  2' 

.3 

Teacher  3 

J  School  E 

3 

Teacher  4 

American 
History 

3 

Teacher  5 

3 

is 


Participating  at  School  A  were  four  sections  of  Biology  1.  ' 
Students  attending  School  A  are  drawn  from  different  ethnic  groups 
of  varying  socioeconomic  status  within  the  Urbana  township. 
Approximately  one-third  of  the  students  are  bused  from  black 
coitinunities;  the  remainder  walk  from  white  coramunities  neighbbring 
the  University  of  1111 nois,  many  from  households  of  University 
faculty  and  staff .  f  ' 

Participating  at  School  B  were  three  sections  of  Biology  1, 
one  section  of  advanced  Biology  and  three  sections  of  Amierican 
History.    Students  attending  School  B  are  drawn  from^  both  a  rural 
and  mid-sized  town  populus.   The  students  are  predominantly  white 
arid  most  of  their  parents 'are  Involved  in  some  form  of  agriculture 
or  light  Industry  within  the  town.  •  ' 

"  In  the  third  Illinois  high  school  participating.  School  C, 
the  survey  was  administered  to  one  section  of  Advanced  Biology 
and  one  section  of  American  History.    Students  attending  School  C 
are  drawn  from  both  a  rural  and  smajll  town  populus  residing 
within  Champaign  County.    Students  are  predominantly  white,  and 
their  parents  Involved  in  either  local  farming  Or  associated  with 
'  the  Univerisity.  •  -  ■ 

Of  the  four  IllinoTs  High„Schools,  School  D  1s"located  the 
fur\;hest  from  the  University,  in  a  city  approximately  50  miles 
from  Champaign.    The  Survey  was  administered  to  five  section  of 
American  History  at  School  D.    Students  in  attendance  represent  a 
wide  range  of  ethnic  backgrounds  from  low  to  rtliddle  socioeconomic 
households,  with  parents  primarily  involved  in  factory  work,  at 
the  many  plants  located  within  the  industrial  sections  of  the  city. 
Instrumentation 

The  developmental  phase  of  the  syrvey  spanned  a  three-month 
period,  and  was  a  cooperative  effort  between  the  Texas  and  Illinois 
sites.'  Throughout,  we  were  concerned  about  the  feasability  of 
asking  students  and  teachers  to  respond  to  a  survey  about  text- 
book use.  -fhus,  we  adopted  two  guidelines  in  developing  the 
survey: 

1.   time  allotted  for  data  collection  ^tibuld  be  restricted 
to  one  class  period;  and 


2.    the  Instrument  should  be  a  ^If-report  measure  employing 
forced  choice. 

Initial  drafts  of  tbe  survey  were  composed  of  a  variety  of  probes 
: as  well  as  a  variety  of  response  schemes.    However y  anticipating 
a  wide  range  in  reading  ability  both  within  and  across  classes, 
we  were  led  to  simplify  both  ^he  format  and  the  phrasing  of  the 
survey  considerably.    Appendix  A  presents  Form  k  which  was 
administered  to  subjects  in  Texas;  Appendix  B,  Form  B  which  was 
administered  to  subjects  in  Illinois.    The  reason  for  different 
forms  will  be  explained  momeintarily.    Each  of  the  research 
questions  identified  earlier  became  the  focus  of  one  subsection 
of  the  survey.    An  attempt  was  made  to  address  each  research  ques- 
tion in  terms  of  one  main  probe  that  served  as  the  stem  of  a  number 
of  sentences  in  that  subsection.    In  addition,  an  appropriate 
response  scale  was  designed  in  conjuction  with  each  of  the  four 
probes.    The  sections  ran  anywhere  from  12  to  21  items  in  length. 
Table  2.2  lists  eath  of  the  four  probes  as  they  appeared  on  Form  A 
and  Form  B  of  the  survey,  as  well  as  the  number  of  items  and 
response  options  associated  with  each.    The  two  most  significant 
differences  between  Form  A  and  Form  B  are:    (1 j  Form  A  has  five 

response  options  while  Form  B  has  four,  and  (2)  Form  A  does  not  

include  subsection  4  of  the  survey. 

During  the  final  stages  of  development,  teachers  of  those 
students  participating  in  the  study  were  given  a  copy  of  the 
survey  and  asked  to  evaluate  it  in  terms  of  the  appropriateness 
of  the  questions,  the  comprehensiveness  of  the  items,  the  clarity 
.of  the  directions,  and  general  readability.^   Form  A  reflects 
changes  made  subsequent  to  recommendations  solici.ted  from  the  six 
Texas  teachers,  but  prior  to  those  made  by  the  six  Illinois 
teachers.  Form  B  reflects  changes  madie  following  the  recommendations 
of  teachers  from  Texas  as  well  as  Illinois. 

The  prevailing  concern  of  the  teachers  related  to  readability. 
Several  teachers  suggested  that  both  directions  and' items  be 
reworded  in  order  that  they  more  closely  approximate  high  school 
students*  "everyday"  usage.    In  addition,  it  was  recommended  by 
three  of  the  six  Illinois  teachers  that  the  response  scale  be 


TABLE  2.2 

Probes  Used  in  Overview  of  Survey  Forms  A  &  B 


Sub- 
section 


Probe 


Number  of 
Items 


Response  Options 


Form  A 


1 

When  you  study  a  chapter  in  ypur 
textbook,  to  what  extent  dp  you 
use  the  following  methods  of  study? 

19 

never 

almost 
never 

sometimes 

almost 
always 

always 

2 

How  often  do  you  find  a  chapter  in 
your  textbook  difficult  to  under- 
stand because: 

13 

never 

almost 
never 

sometimes 

almost 
never 

always 

3 

When  you  read  a  chapter  in  your 
textbook,  to  what  extent  do  you 
have  difficulty  with  each  of  the 
following? 

18 

a  lot  of 
difficulty 

some 
difficulty 

ocasional 
difficulty 

rarely  any 
difficulty 

never  any 
difficulty 

■  1 

Form  B 


3. 
4. 


Listed  below  are  things  your  teacher 
may  do  sometimes  with  your  textbook. 
Indicate  whether  you  would  agree  that 
it  is  important  that  your  teacher  do 
the  following. 


17 


12 


When  you  study  a  chapter  in  your 
textbook,  how  often  do  you  use 
the  following  methods? 

How  often  do  you  find  that  the 
following  are  querstions  which  make 
your  textbook  difficult  to  understand? 

When  you  §tudy  a  chapter  in  your  text-  18 
book,  howdifficult  is  it  for  you  to: 
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never 


never  a 
problem 

never 
difficult 

strongly 
disagree 


sometimes 


sometimes 
a  problem 

hardly  ever 
difficult  ; 

disagree 


almost 

always 

always 

almost 

always  a 

always  a 

problem 

problem 

sometimes 

very 

difficult 

difficult 

agree 

strongly 

agree 

ft 
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reduced  from  five  to  four  options.   Form  B  of  the  survey  reflects 
an  attempt  to  acconmodate  these  recommendations.    It  had  been  our 
concern  that  the  Items  were  eltter  not  representative,  not  compre- 
hensive, or  possibly  both.    Interestingly  enough,  the  teachers 
seemed  more  concerned  with  the  abundance  of  Items,  and  pointed 
out  that  since  some  of  the  Items  were  too  specific  In  nature, 
they  be  combined  with  one  or  more  of  the  others  to  form  more 
global  questions.    '  * 
Procedures  .  fHi  c 

Two  weeks  prior  to  the  administration  of  the  survey,  parental 
consent  forms  were  distributed  and  then  collected.    Only  those 
students  receiving  the  consent  of  their  parents  were  allowed  to 
participate.   As  reported  in  the  previous  section,  the  teachers 
were  acquainted  with  the  survey  in  advance  of  its  administration, 
but  were  asked  not  to  share  or  discuss  it  with  students.    On  the 
day  of  the  experimenter's  first  visit  to  each  classroom*^he 
survey  data  was  collected.    General  introductions,  and  a  brief 
overview  of  project  goals  as  they  relate  to  the  roles  of  students 
and  teachers  Participating  in^the  |uryej^,^^^^ 
well  as  Experiments  1  and  Z/fmere  discussed,  after  which  the 
students  were  given  copies  of  the  survey  and  asked  to  respond  to 
each  item  as  candidly  as  possible.   Aside  from  the  specific 
written  directions  preceding  each  subsection  of  the  survey, 
students  were  Instructed  to  answer  each  question  as  it  applied 
to  the  History  or  Biology  textbook  1n  use  at  that  time  in  their 
respective  classrooms.   Administration  ran  approximately  forty 
minutes  per  class. 
Method  of  Analysis 

As  pointed  out  earlier,  not  only  were  the  Texas  and  Illinois 
populations  comparatively  different  but  the  textbook  surveys 
administered  at  each  site  varied  slightly  in  content  and  in 
response  format  across  sites  (Form  A  was  completed  by  subjects 
in  Texas;  Form  B  was  completed  by  subjects  in  Illinois).  These 
differences,  particularly  the  Tatter,  precluded  our  combining 
Texas  and  Illinois  data  for  purposes  of  analysis.    Thus  the 
analysis  procedures  were  identical  for  both  sets  of  data; 
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I.  What  Strategies  Oo  High  School  Students  Implement  When  They  Study? 
^ Overall  4^r€nds  ,  -   

•  High  school  studehts  enrplled  in  social  studies  and  biology 
classes,  use  a  restricted  range  of  study  strategies.  Most 
students  rarely  Implement  strategies  for  dealing  with  their 
texts.    The  most  frequent  study  behaviors  reported  by 
students  were  to  memorize  portions  of  the  chapter,  complete 
textbook  questions  and  activities,  at  the  same  time  as 
they  read  the  chapter  through  only  once,  and  rarely,  if  at 
all,  refer  to  any  other  source.    Other  than  the  textbooks, 
they  relied  on  classnotes,  worksheets,  and  handouts. 

•  Students  enrolled  in  Biology  versus  History  enlist  the 
same  restricted  array  of  study  strategies.    However,  there 
are  some  fluctuations  across  sites  and  subject  areas.  In 
Texas,  History  students  report  they  use  study  strategies 
more  frequently  than  the  counterparts  enrolled  in  Biology. 
In  Illinois,  the  reverse  was  found.    In  both  states,  there 
was  a  tendency,  albeit  slight, for  history  students  to 
reread  more  frequently, "Use  chapter  summaries,  complete 
worksheets ,  try  .to  jromri  remand  to _be  JjBS5:^^^^^   — 
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complete  textbook  exercises  or  use  classnotes. 
While  female  students  tended  to  use  more  study  strategies 
than  thelrmalecounterparts,  the  strategies  used  by  both 
groups  were  largely  the  same.    Females  were  slightly  more 
likely  to  engage  th^  following  behaviors:    read  the 
chapters  aloud,  underline,  take  notes  and  solicit  the 
assistance  or  engage  in  discussion  with  other  students. 
Males  tended  to  refer  to  other  sources  and  to  read  the 
chapter  summaries.  V 

If  history  and  biology  are  considered  separately,  some 
interesting  sex  differences  emerge.    Males  use  a  wider 
array  of  strategies  more  frequently  for  dealing  with 
biology  text  than  females;  females  use  a  wider  array  than 
males  for  dealing  with  history. 
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however,  the  data  were  treated  as  the  outcome  of  two  separate 
Investigations.    However,  since  the  surveys  included  substantially 
similar  content,  generalizations  from  findings  are  discussed  across 
sites. 

The  following  descriptive  statistics  were  computed  within  but 
not  across  Forms  A  and  B:    the  mean  response  per  Items  and  its 
corresponding  standard  deviation,  as  well  as  the  raw  frequency  per 
response  per  item  and  its  corresponding  proportional  value. 
Each  statistic  was  computed  for  each  item  first  by  combining  the 
responses  of  all  respondents,  then,  by  separating  vKe"  respondents 
Into  male  and  female  groups,  and  finally,  by  separating  respondents 
Into  History  and  Biology  groups. 

.  Results 

We  present  results  of  the  survey  by  discussing  in  turns  each 
of  the  four  subsections  of  the  survey: 

1.  What  strategies  do  high  school  students  implement  when 
they  study? 

2.  What  aspects  of  textbooks  do  high  school  perceive  as 
contributing  to  difficulties  they  experience  when 
attempting  to  understand  what  they  read? 

3.  What  do  high  school  students  perceive  to  be  their 
strengths  and  weaknesses  relative  to  textbook  learning?  , 

4.  With  respect  to  content  area  teachers,  what  instructional 
focus  and/or  strategies  do  high  school  students  consider 
important? 

5.  What  is  the  teachers'  perception  of  the  typical  history 
and  biology  "student's  responses  to  the  survey? 
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Discussion  of  Result  ^ 

Texas,  Form  A  (See  Table  3A  and  3B)*:  To  what  extent  to  high 
school  students  impl-ement  strategies  when  they  study?  Fourteen  of 
the  eighteen  strategies  are  implemented  "almost  always"  or  "always" 

fewer  than  20%  of  the  students;  thirteen  of  the  eighteen 
strategies  are  implemented  "almost  never"  or  "never"  by  over  50%. 
Only  in  the  case  of  item  5  (answer  questions  and/or  complete 
activities  in  the  chapter),  item  6  (attempt  to  mertorize  portions 
of  the  chapter);  and  item  7  (read  the -chapter^^ffirough  only. once— 
jirfithout  or  .before  engaging  in  any  other  activities,  e.g.,  note- 
taking,  outlining,  underlining)  did  slightly  more  than  30%  of  the 
students  report  that  the  method  was  "almost  always"  or  "always" 
implemented.    The  most  frequently  chosen  q||jy)onse  option  per  item 
vacilated  betwe^  "never",  "almost  never"  and  "sometimes". 

Do  strategies  differ  in  terms  of  how  frequently  they  are 
implemented  by  high  school  students?  The  difference  between  the 
smallest  and  largest  mean  response  across  items  is  1.6407  or  41% 
of  the  greatest  possible  difference.    What  strategies  are  used 
-  most  frequently  by  high  school  students?   The  two  largest  means, 
those  falling  nearer  Z°5,  are  associated  with  items  5  (answer 
questions  and/or  complete  activities  provided  in  the  chapter)  and 
7  (read  the  chapter  through  only  once—without  or  before ^rigaging 
in  any  other  activities,  e.g.,  not^taking,  outlining,  underlining), 
X=3.0327  and  )r°3. 1825  respectively..   It  should  be  noted,  however, 
that  neither  of  the  two  strategies  are  implemented  without  fail 
by  any  more  than  13%  of  the  students. 

What  strategies  are  used  least  frequently  by  high  school 
students?   The  two  smallest  means,  those  falling  nearer  X«l,  are 
associated  with  items  ,1  (construct  an  outline(s)  for  information 
in  the  chapter)  and  13  (read  the  entire  chapter  or  portions  of  it 

mm  ^  w 

aloud),  X-1.5418  and  X«l. 8242  respettively.    More  students 
responded  "never"  (64%)  and  fewer  students  responded  "always"  to 
item  1  than  to  any- of  the  other  seventeen.    Item  1  also  has  the 
smallest  standard  deviation.   With  respect  to  item  13,  54%  of  the 
students  reported  that  they  "never"  read  the  entire  chapter  or 
portions  of  it  aloud.  Mlhese  and  all  subsequent  tables  for  this 
section  appear  in  Appendix  &.) 
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Illinois,  form  B  (See  Table  4A  and  4B):    To  what  extent  do 
high  school  students  implement  strategies  when  they  study?  With 
respect  to  all  but  one  of  the  strategies,  over  62%  of  the  students 
reported  that  the  method  was  either  "never'!  used  or  used  "sometimes" 
the  latter  the  most  frequently  chosen  response  option  across  all 
sevente^  strategies.    In  one  case  only,  item  6(  try  to  memorize 
important  parts  of  the  chapter),  did  over  50%  of  the  students 
report  that  the  method  was  "almost  always"  or  "always"  implemented. 

Do  strategies  differ  in  terms  of  how  frequently  they  are  used 
by  high  school  students?   The  difference  between  the  smallest  and 
largest  mean  response  across  items  is  1.4323,  which  is  slightly 
less  than  half  of  the  greatest  possible  difference.    WKat  strategies 
are  used  most  frequently  by  high  school  students?   The  two  largest 
means,  those  falling  nearer  X=4,  are  associated  with  items  6  (try 
to  memorize  Important  parts  of  the  chapter)  and  11  (read  the 
chapter  through  only  once—without  doing  or  before  you  do  any 
notetaking,  outlining,  underlining,  etc.) ,  1=2.7061  and  X=2. 2939 
respectively.    More  students  responded  "always"  (24%)  and  fewer 
students  responded  "never"  (9%)  to  item  6  than  to  any  of  the  other  ^ 
sixteen  items.    As  the  percent^e  of  students  responding  *'alwaiyV' 
was  only  24%,  it  was  never  the  case  that  more  than  a  quarter  of  the 
students  indicated  that  a  particular  strategy  was  something  they 
used  without  fail.    With  respect  to  item  11,  while  17%-reported 
that  they  always  read  the  chapter  through  only  once,  which  is  the 
second  highest  proportion  of  responses  to  the  "always"  response 
option,  63%  reported  that  the  strategy  was  used  "sometimes"  or 
"never".    As  may  be  the  case  with  the  54%  who  responded  similarly 
to  the  identicaV^  item  on  Form  A,  this  63%  may  include  students  who 
either  never  read  the  chapter,  never  read  the  entire  chapter,  or 
read  the  chapter  more  than  once.    In  light  of  responses  to  item  12 
(reread  the  chapter  several  times), it  seems  reasonable  to  rule  out 
the  latter  as  a  likely  interpretation.    In  response  to  item  18 
(Sflfi^Table  24),  the  free  response  item  eliciting  methods  of  study 
which  are  used  but  which  were  not  mentioned  within  the  forced 
choice  portion  of  the  survey,  11%  of  the  students  reported  the  use 
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provided  1n  the  text. 

What  strategies  ar6  used  least  frequently  by  high  school 
students?   The  two  smallest  means,  those  falling  nearer  X=l ,  are 
associated* with  Items  17  (read  other  books,  on  the  toplc(s)  discussed 
In  the  chapter)  and  13  (read  the  entire  chapter  or  parts  of  It  aloud 
to  yourself),  7=1  .2738  and  X=1.6398  respectively.  "  More  students 
responded  "never"  (74%)  and  fewer  students  responded  "alwaVs"  (.3%) 
to  Item  17  than  to  any  of  the  other  sixteen  Items.    In  other  words, 
258  out  of  the  347  high  school  students  reported  that  they  never 
read  other  books  on  the  toplc(s)  discussed  -In  chapters  In  their 
textbooks;  one  male  reported  that  he  did.    It  Is  not  surprising 
that  Item  17  also  has  the  smallest  standai^d  deviation  across  Items 
In  the  first  subsection  of  the  survey.    Item  13  has  the  smallest  - 
mean,  with  a  little  over  50%  of  the  students  Indicating  that  they 
never  read  the  entire  chapter  or  portions  of  It  aloud  for  study  ^ 
purposes. 

Trends  Within  and  Across  Subject  Areas 

Texas,  Form  A  (S^e  Table  5A,  5B,  and  5C):    Do  Biology  and 
History  high  school  students  differ  with  respect.to  the -strategies 
they  Implement  when  they  study?   The  largest  difference  .between  the 
mean  responses  of  Biology  and  History  students  on  any  one  Item  Is 
.5422  or  13.5%  of  the  greatest  possible' difference.    This  difference 
occurred  In  response  to  Item  13  (read  the  entire  chapter  or  portions 
of  It  aloud) Hlstor^  students  reporting/a  more  frequent  use  of  the 
strategy  than  Biology  students.  4teifi  15  (answer  questions  and/or 
complete  activities  provided  In  the  chapter)  produced  a  similar 
difference, HI story  students  again  reporting  a  greater  use  of  he 
strategy.    The  difference  between  the  mean  responses- of  Biology 
and  History  students  decreased  to  .2%  In  the  case  of  Item  16, 
where  62%  of  the  Biology  students  and  84%  of  the  History  students 
reported  tha/t  they  never  read  other  sources  on  the  toplc(s) 
covered  In  tfie  chapter.    The  mean  of  History  students  exceeded 
that  of  Biology  students  on  sixteen  of  the  eighteen  Items;  however 
th1s*cl1fference  never  exceeded  13.5%  of  the  greatest  possible 
difference. 
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in^1s.  Fom  B^See  fable  6^^^^  Do  Biology  and 

History  students  differ  with  respect  to  the  strategies  they  use 
when  they  study?   The  largest  difference  between  the  mean  responses 
of  Biology  and  History  students  on  anyjwe-ltem  Is  .6227.  which  Is 
22%  or  slightly  less  than  one-fourth  of  the  greatest  possible 
difference.*  This  difference  occurred  in  response  to  Item  9  (review 
all  the  headings  In  the. chapter  before  you  begljK'Co^ read  the 
chapter)*.  History  students  reporting  a  more  frequent  use  dr*f  the 
strategy  than  Biology  students.    Item  10  (r^ad  the  chapter  sunmary 
befOQjf  you  begin  to  read  the  chapter)  produced  a  difference  14%  of 
the  greatest  possible  difference.  Biology  students  again  reporting^ 
a  greater  use  of  the  strategy.   The  difference  between  the  mean 
responses  o? Biology  and  History  students  decreased  to  .3%  In  the 
case  of  Item  17.  where  74%  of  the  Biology  students  and  7S%  of 
the  History  students  reported  that  they  never  read  other  books  on 
the  toplc(s)  discussed  In  textbook  chapters.    While  It  may  appear 
significant  that  the  mean  responses  of  Biology  students  exceeded 
"^hose  of  History  students  with  respect  to  eleven  of  thd  seventeen 
strategies,  the  fact  remains  that  among  Biology  and  History 
students.  12  of  the  17  study  strategies  are  Occasionally  If  ever 
used  by  at  least  7A%  of  the  students.    In  response  to  Item  18 
(see  Table  24),  154  of  the  History  students  reported  tbe  use  of 
worksheets  as  compared  to  4.8X*of  the  Biology  students.  However, 
slightly  mo^  Biology  students  reported  the  use  of  classnotes 
than  history  students Ts.BIl  and  4.4«  raspect1velj\  Methods 
reported  by  Biology  students  only  Include:    look  up  words  In  the 
glossary  (1.4«)i  study  class  asslgnmentsd. 4%).  ^ 
Trends  Within  and  Across  Gender  , 

Texas.  Form  A  (See  Tables  7A  through  76):   Do  male  and 
female  high  school  students  differ  with  respect  to  the  strategies. 
they  use  when  they  study?  The  largest  difference  bet^Seen  the  mean 
responses  of  males  and  females  on  any  one  Item  Is  .3763  which  Is 
12.5*  or  one-eighth  of  the  greatest  possible  difference.  This 
difference,  occurring  In^response  to  Item  13  (read  the  entlrff. 
chapter  or  par1;s  of  It^oud  to  yourself),  was  sj'ightly  less  than 
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twice  as  large  as  the  second  largest  difference  which  occurred  in 
response  to  item  3  (underline  important  ideas  in  the  chapter).  The 
difference  diminished  to  .26%  on  it6m  9,  where  44%  of  the  males  and 
43%  of  the  females  reported  that  tifey  never  review  all  the  headings 
given  in  a  chapter  before  reading  the  chapter.    In  addition ^  for 
twelve  out  of  the  seventeen  items,  the  mean  response  of  females  is 
greater  than  the  mean  response  of  males. 
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II.   What  Characteristics  of  Textbooks  Do  High'School  Students 
Perceive  as  Contributing  to  Difficulties  They  Experience- 
When  Attempting  to  Understand  What  They  Read?  , 

Overal 1  Trends 

•  High  school  students  identified  a  variety  of  characteristics 
as  causing  difficulties  at  least  some  of  the  time  when  they 
read  their  textbooks.    Those  charactertstics  that  students 
most  frequently  identified  as  problematic  included  that 

(a)  important  ideas  were  not  clearly  pointed  out; 

(b)  students  were  expected  to  know  more  than  they  do;  and 

(c)  not  enough  examples  or  clarification  of  key  ideas  were 
provided. 

In  conjunction  with  students' concern  for  main  ideas,  several 
students  suggested  greater  use  might  be  made  of  bold  face 
;    .      print.   Also,  in  terms  of  free  responses  both  history  and 
biology  students  complained  that  their  texts  were  boring. 

Less  frequently,  students  expressed  the  following  concerns: 

(a)  ideas  were  not  related  to  what  students  already  knew; 

(b)  vocabulary  was  difficult  to  understand;  (c)  topics 
were  not  covered  in  as  much  detail  as  needed;  and 

(d)  relationships  between  important  ideas  were  not  pointed 
out.  ^ 

»      ■  ■  ■  ■  ■  • 

•  Across  subject  areas,'  history  textbooks  tended  to  be 
identified  more  frequently  than  biology  textbooks  as  dis- 
playing characteristics  which,  were  problematic.    In  both 
Texas  and  Illinois,  Biology  textbooks  were  criti zed  more 
than  History  textbooks  for  the  difficulty  level  of  their 
vocabulary,  the  amount  of  detail  prdvided  and  the  tendency 
to  expect  students  to  know  more  than  they  should-  In 
Texas,  the  students  complained  that  their^ history 
textbook  was  out-of-date.    In  Ilttnois,  students  complained 
that  the  important  ideas  were  not  clearly  pointed  out. 

-    •   Females  suggested  that  their  textbooks  exhibited  more 

problems  than  their  male  counterparts,  though  both  groups 
were  similar,  and  consistentily  critical.   This  .difference^^ 
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.  V  between  the  sexes  was  more  prevalent  for  biology  than 

'       history  and  the  major  complaints  females  expressed  were 
for  the  vocabulary  and  what  students  were  expected  to 
'  know. 

Discussion  of  Results 

Texas,  Form  A  (See  Tables  9A  and  9B):    Do  high  school  students 
perceive  characteristics , of  textbooks  as  contributing  to  difficulties 
^     they  experience  wherv  attempting  to  understand  what  they  read?    It  was 
nevier  the  case  that  more  than  35%  of  the  students  reported  that  a 
particular  textbook  characteristic  was  "almost  always"  or  "always" 
a  problem;  ten  of  the  thirteen  text  characteristics  are  considered 
by  at  least  40%  but  no  more  than  6^%  of  the  students  to  be  "almost 
never"  or  "never"  a  problem.  "Sometimes*^*  problem"  was  the  most 
frequently  chosen  response  option  in  the  case  of  eleven  of  the 
thirteen  items.  ^ 

What  characteristics  are  cited  as  frequent  problems?  The 
two.  largest  mean^  occurred  Iti  response  to  item  2  (the  text  does  not 
point  out  the  main  ideas)  and  item  11  (the  item  does  n,ot  include  a 
good  surrinary  of  the  chapter),  X=2.7802  and  r=2. 9375  respectively. 
It  should  be  noted,  however,  that  these  two  means  reflect  a  response 
of  "almost  always"  or  "always"  a  problem  by  only  21%  of  the  students 
in  the  case  of  item  2  and  35%  of  the  students  in  the  case  of  item  11. 
In  addition,  responses  to  item  2  resulted  In  the  smallest  standard 
deviation  of  the  thirteen,  while  responses  to  item  11  resulted  in 
the  largest. 

Are  any  characteristics  "never  a  problem?"    For  a  greater 
percentage  of  the  students  the  textbook  Characteristics  listed 
,  ,  tend  to  be  either  "sometimes  a  proM^ii^or  "never  a  t)roblem;" 

-  The  two  smallest  means,  those  fiTling  nearerST^l ,  occurred  in 

response  to  item  9  (the  text  presents  irrelevant  information  which 
is  not  related  to  the  purposes  for  which  the  text  is  intended),  and 
Item  5  (the  text  is  poorly, organized;  that  is,  the  text  is  written 
In  a  way  which  is  difficult  to  follow),  7=2.1927  and  X=2. 400 
respectively.    The  characteristic  described  by  item  9  is  apparently 
"never  a  problem"  for  24%  of  the  students;  the  characteristic 
described  by  item  5  "never  a  problem"  for  19%  of  the  students. 
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Illinois,  Form  B  (See  Tables  1  OA  and  lOB):-  Do  high  school 
students  perceive  characteristics  of  textbooks  as  contributing  to 
difficulties  they  experience  when  attempting  to  understand  what 
they  read?    It  was  never  the  case  that  more  than  30%  of  the  students 
reported  that  a  particular  textbook  characteristic  was  "almost 
always  a  problem"  or  "always  a  problem."    "Sometimes  a  problem" 
was  the  most  frequently  chosen  response  option  across  eleven  of 
the  twelve  items;  with  respect  to  ten  out  of  the  twelve,  at  least 
70%  of  the  students  indicated  that  the  characteristic  was  either 
"sometimes  a  problem"  or  "never  a  problem."   The  homogeneity  of  the 
responses  becomes  evident  when  one  considers  that  the  difference 
between  the  largest  and  smallest  mean  response  across  items  is 
.5129  or  17%  of  the  greatest  possible  difference. 

What  characteristics  are  cited  as  frequent  problems?  The 
characteristics  described  by  items  2  (the  text  does  not  tell  you 
which  ideas  in  the  chapter  are  important;  that  is,  which  idea^  you 
should  remember)  and  9  (the  text  expects  you  to  know  inrore  about 
what  you  are  reading  than  you  usually"  do)  were  perceived  by' more 
students  to  be  frequent  problems  than  any  of  the  other  textbook 
characteristics;  that  is,  the  mean  responses  associated  with  items 
2  and  9  were  the  largest.    However,  the  percentages  associated  with 
t'hese  items  (summing  across  the  "almost  always"  and  "always" 
response  categories)  are  but  36%  and  33%  respectively.    When  asked 
on  item  13  (see  Table  24)  to  describe  any  othfer  weaknesses  of  the 
textbook  which  were  not  mentioned  in  the, forced  choice  protion  of 
the  survey,  8.3%  of  the  students  reported  that  the  text  was  boring, 
2.3%  that  either  no  g^lossary  was  provided  or  a  better  one  was- 
needed,  and  1.4%  that  the  chapters  are  either  tdfo  long  or  cover 
too  many  topics. 

Are^any  characteristics  "never  a  problem?"   As  reported 
above  for  most  students  eleven  of  the  characteristics  are  apparently 
a  problem  "sometimes"  as  opposed  to  "never,"  "almost  always,"  or 
"always."    In  the  case  of  the  remaining  characteristic  (the  text  is 
out-of-date;  that  is,  the  text  does  not  discuss  current  issues), 
close  to  50%  of  the  students  reported  that  it  was  "never  a  problem." 
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Strengths  of  the  textbook  described  in  response  to  it'eni  13  (see 
Table  24)  included  the  presence  of  bold  face  print  reported  by 
6.6%  of  the  students,  and  the  inclusion  of  pictures,  charts,  maps, 
graphs  and/or  diagrams,  reported  by  11%  of  the  students. 
Trends  Within  and  Across  Subject  Areas 

Texas,  Form  A  (See  Tables  llA,  IIB,  and  llC):   Are  same  text- 
book characteristics  more  frequently  a  problem  in  one  subject  area 
than  in  th6  other?   The  mean  response  of  Biology  students  exceeded 
that  of  History  students  on  ten  out  of' the  thirteen  items.  The 
largest  difference,  however,,, between  the  two  means  on  any  one  item 
was  .4781  or  11.9%  of  the  greatest  possible  difference.  This 
difference  occurred  in  response  to  item  1  (the  text  uses  vocabulary 
which  is  difficult  to  understand),  the  characteristic  reportedly 
less  a  problem  in  History  than  in  Biology.    A  similar  difference 
occurred  in  response  to  item  13  (the  text  goes  into  more  detail 
than  is  appropriate  for  your  purposes),  9.22%  of  the  greatest 
possible  difference  and  the  mean  of  Biology  students  again 
exceeding  that  of  History  students.    The  difference  between  the 
mean  responses  of  Biology  and  History  students  decreased  to  2.1% 
in  the  case  of  item  7  (the  text  does  not  attempt  to  relate  ideas 
to  what  you  already  know  about  the  topic). 

Illinois,  Form  B  (See  Tables  12A,  12B,  and  12C):    Are  some 
textbooks  characteristics  more  frequently  a  problem  in  one  subject 
area  than  in  the-  other?   The  mean  response  per  item  associated  with 
History  exceeded  that  of  Biology  in  eighf  instances  out  of  the 
twelve.  However,  the  largest  difference  between  the  two  means  on 
any  one  item  is  .1906  or  6%  of  the  greatest  possible  difference. 
This  difference  occurred  in  response  to  item  12  „(the  text  is  out-of 
date;  that  is,  the  text  does  not  discuss  current  issues),  this  char 
acteristic  was  perceived  as  less  of  a  problem  in  Biology  than  in 
History,  ""item  1  (the  text  uses  words  which  are  difficult  to  . 
understand)  produced  a  similar  difference,  5%  of  the  greatest 
possible  difference,  vocabulary  reportedly  less  a  problem  in 
History  than  in  Biology. 
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The  free  response  item  (see  Table  24)  produced  other  inter- 
esting differences.    Bold  face  print  was  reported  as  a  strength  of 
the  textbook  by  13.5%  of  the  Biology  students  as  compared  to  1.9% 
of  the41istory  students.    Similarly,  more  Biology  students  than 
History  students  mentioned  as  a  strength  the  inclusion  of  pictures, 
charts,  maps,  graphs  and/or  diagrams,  17.3%  and  6.2%  respectively. 
In  addition,  that  the  textbook  defines  words  clearly  was  reported 
by  6.9%  of  the  Biology  students  only.    When  asked  to  describe  any 
other  weaknesses  of  the  textbook,  10.3%  of  the  History  students 
as  compared  to  5.6%  of  the  Biology  students  reported  that  the 
textbook  Is  boring.    Weaknesses  mentioned  by  students  from  only 
one  subject  area  Include:    dates  reported  irrespective  Of  chronolo- 
gical order,  reported  by  3.4%  of  the  History  students;  and  the 
inclusion  of  drawings  which  are  unrealistic,  reported  by  2.8%  of 
Biology  students. 
Trends  Within  and  Across  Gender 

-   Texas,  Form  A  (See  Tables  ISA  through  13G):    Are  some  text- 
book characteristics  perceived  to  be  more  frequently  a  problem 
than  others  by  one  sex  as  opposed  to  the  other  sex?   The  mean 
response  of  females  exceeded  that  of  males  on  nine  of  the  thirteen 
items.   The  largest  difference,  however,  between  the  mean  responses 
of  males  and  females  on  any  one  item  is  only  .3001  or  7.5%  of  the 
greatest  possible  difference  between  means.    This  difference 
occurred  in  response  to  item  1  (the  text  uses  vocabulary  which  is 
difficult  to  understand),  the  mean  of  females  exceeding  that  of 
males.   A  similar  difference  occurred  in  response  to  item  3  (the 
text  expects  you  to  know  more  about  what  you  are  reading  than  you 
do);  the  mean  of  females  again  exceeded  that  of  males.  The 
difference  decreased  to  .14%  in  the  case  of  item  5  (the  text  is 
poorly  organized;  that  is,  the  text  i's  written  in  a  way  which  is 
difficult  to  follow),  where  58%  of  the  males  and  60%  of  the  females 
reported  the  particular  textbook  characteristic  as  "almost  never" 
or  "never"  a  proble|n. 


32 

2.18 


iniriois,  Form  B  (See  Tables  lAA^hrough  14G):   Are  some 
textbook  characteristics  perceived  to  be  more  frequently  a  problem 
than  other  characteristics  by  one  sex  as  opposed  to  the  other?  The 
mean  response  of  males  exceeded  that  of  females  in  six  out  of  the 
twelve  cases;  the  reverse  was  true  with  respect  to, the  remaining 
six,   The  greatest  difference  between  the  means  of  male  students 
and  female  students  on  any  one  item  occurred  in  response  to  items 
9  (the  text  expects  you  to  know  more  about  what  you  are  reading 
than  you  usually  do)  and  11  (the  text  spends  too  much  time  discussing 
Ideas  the  teacher  does  not  expect  you  to  know),  where  males 
indicated  that  the  former  was  less  frequently  a  problem  and  the 
latter  more  frequently  a  .problem  than  did  females.   The  difference 
in  both  Instances  was  but  6%  of  the  greatest  possible  difference. 
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III.    What  Do  High  School  Students  Perceive  to  be  Their  Strengths  and 

Weaknesses  Relative  to  Textbook  Learning? 
Overall  Trends 

•  Most  high  school  students  reported  that  they  encountered 
some  difficulty  with  the  strategies  they  use  for  learning 
from  their  textbooks.    Their  major  difficulties  were  with 
concentrating  while  reading,  remembering  what  was  read. 

1^  knowing  how  well  the  Information  will  be  remembered  and 

^  identifying  relationships  between  ideas.   Most  students 
reported  encountering  a  lot  less  difficulty  with  the 
strategies  which  seem  to  receive  most  emphasis  in  their 
study  skill  curriculum.    Namely,  students  report  little 
difficulty  Interpreting  diagrams  and  graphs,  changing  rate 
of  reading,  notetaking,  and  outlining. 

•  The  types  of  difficulties  students  reported  varied  only 
slightly  across  subject  areas  and  inconsistently  across 
states.    In  Texas  students  reported  more  difficulty 
employing  study  strategies  in  History;  in  Illinois  the 

-  reverse  was  the  case. 

•  The  findings  related  to  sex  differences  were  similar  to 
the  findings  for  subject  area.  Temales  reported  more 
difficulty  with  biology  than  their  male  counterparts; 
males  reported  more  difficulty  with  history. 
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Discussion  of  Results 

Texas,  Form  A  (See  Table  15):    Do  high  school  students 
perceive  some  study-related  goals  or  strategies  as  more  or  less 
difficult  than^therrtoTchieve  or  Tmpnementr"WiTh  the  exception 
of  those  two  strategies^ associated  with  items  17  (remembering 
what  you  have  read  a  week  later)  and  18  (concentrating  as  you 
read  the  chapter),  no  more  than  14%  of  the  students  responded  to 
a  given^item  by  reporting  that  they  experience  "a  lot  of  difficulty; 
similarly,  it  was  never  the  case  that  more  than  20%  of  the  students 
responded  to  an  item  with  "never  any  difficulty."  "Occasional 
difficulty"  was  the  most  freqently  chosen  response  option  to 
eleven  of  the  eighteen  strategies;  "rarely  any  difficulty"  the 
most  frequently  chosen  response  option  to, five  of  the  eighteen; 
The  difference  between  the  largest  and  smallest?  mean  response  is 
33%  of  the  greatest  possible  difference. 

What  do  high  school  students  perceive  to  be  their  strengths 
relative  to  textbook  learning?    In  response  to  item  4  (interpreting 
diagrams,  graphs,  etc.),  item  11  (answering  questions  or  completing 
activities  the  teacher  has  provided),  and  item  6  (taking  notes 
while  you  read  the  chapter)  at  least  50%  of  the  students  reported 
that  they  rarely  experience  any  difficulty  or  never  experience 
any  difficulty.    The  largest  means,  those  falling  nearer  J°5t  are 
associated  with  items  4  and  11,  1=3.4338  and  X-3.4630  respectively. 
In  addition,  responses  to  item  11  resulted  in  the  smallest 
standard  deviation  across  the  eighteen  items. 

►      -  ■ 

What  do  high  school  students  perceive  to  be  their  weaknesses 
relative  to  textbook  learning?   The  two  smal 1  est  mean  responses , 
those  failing  nearer  a  mean  response  of  X=l ,  are  associated  with 
item  17  (remembering  what  you  have  read  a  week  later)  and  item 
18  (concentrating  as  you  read  the  chapter),  X=1.0367  and  ^"l. 2408 
respectively.    In  the  case  of  item  17,  68%  of  the  students 
reported  "some  difficulty"  or  "a  lot  of  difficulty;"  48%  of  the 
students  responded  similarly  to  item  18.    The  standard  deviation 
associated  with  the  former  is  one  of  the  three  smallest  of  the 
eighteen. 
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minois.  Form  B  (See  Table  16):   Do  high  school  students 
perceive  some  study.-related  goals  or  strategies  as  more  or  less 
difficult  than  others  to  achieve  or  implement?  "Sometimes 
difficult"  was  the  most  frequent  response  to  all  but  five  items, 
"hardly  ever  difficult"  the  most  frequent  response  to  four  out  of 
the  eighteen,  and  "very  difficult"  the  most  frequent  response  to 
item  17  only.    The  difference  between  the  largest  and  smallest 
mean  response  is  1.1959  or  39.8%  of  the  greatest  possible  difference. 
Note  that  the  tendency  of  the  distribution  to  be  skewed  in  any  one 
direction  is  slight,  since  in  fifteen  out  of  the  eighteen  cases  at 
least  45%  of  the  students  reported  that  the  study  goal  or  strategy 
was  "sometimes  difficult"  or  "very  difficult,"  and  in  twelve  out 
of  the  eighteen  cases  at  least  40%  of  the  students  reported  that 
the  goal  or  strategy  was  "hardly  ever  difficult"  or  "never  difficult. 

What  do  high  school  students  perceive  to  be  their  strengths 
relative  to  textbook  learning?    In  response  to  items  4  (understand 
diagrams,  graphs,  etc.),  6  (take  notes  from  what  you  have  read  in 
the  chapter),  10  (answer  questions  or  complete- the  activities 
included  in  the  chapter),  11  (answer  the  questions  or  complete  the 
activities  the  teacher  has  provided),  and  12  (change  your  reading 
ra^e  (skimning,  previewing,  reading  slowly)  with  your  purpose  for 
reading  and  type  of  material  you  are  reading),  over  50%  of  the 
students  reported  that  the  strategy  was  either  "hardly  ever 
difficult"  or  "never  difficult."   The  percentage  associated  with 
the. two  strategies  perceived  to  be  the  least  difficult  of  the 
eighteen,  items  4  and  6,  is  .69.    Note,  however,  that  the  largest 
standard  deviation  across  the  eighteen  items  occurred  in  the  case 

of  item  6.  \  . 

What  do  high  school  students  perceive  to  be  their  weaknesses 
relative  to  textbook  learning?    In  response  to  thirteen  out  of  the 
eighteen  items,  ovek^  of  the  students  reported  that  the  goal 
or  strategy  was  "sometimes  difficult"  or  "very  difficult."  The 
strategies  or  goals  associated  with  items  17  (remember  what  you 
have  read  a  week  later)  and  18  (concentrate  as  you  read  the 
chapter)  were  apparently  perceived  to  be  the  most  difficult. 
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421  of  the^  students  Indicating  that  remembering  what  you  have 
read  a  week  later  Is  "very  difficult,"  27%  of  the  students 
reporting  that  concentrating  as  you  read  the  chapter  Is  also 
"very  difficult."   Note  that  the  standard  deviation  paired  with 
item  17  tS/One  of  the  two  smallest.    In  response  to  item  19  (see- 
Table  24)^  the  free  response  Item  eliciting  a  description  of 
difficulties  students  have  when  they  study,  difficulties  which 
were  not  mentioned  within  the  force  choice  portion  of  the  survey, 
7.8%  of  the  students  reported  boredom,  and  .9%  reported  the 
lepgthiness  of  the  chapters.  >^ 
Trends  Within  and  Across  Subject  Areas  ( 


Texas,  Form  A  (See  Table  17):   Are  some  study  goals  or 
strategies  perceived  to  be  more  difficult  to  achieve  or  implement 
by  students  in  one  subject  area^  as  opposed  to  the  other?   The  mean 
response  of  History  students  exceeded  that  of  Biology  students  on 
seventeen  of  the  eighteen  items;  the  largest  difference,  however, 
.between  the  mean  responses  associated  with  any  one  item  Is  .3532 
or  8.8%.    This  difference  occurred  In  response  to  Item  1  (identifying 
important  ideas  in  the  chapter),  the  mean  of  History  students 
exceeding  that  of  Biology  students.    A  similar  difference  occurred 
in  response  to  item  10  (answering  questions  or  completing  activities 
the  text  has  pr(y1ded),  the  mean  of  History  students  again  exceeding 
triat  of  Biology  j/students.    The  difference  decreased  to  .0110  or 
27%  of  the  greatest  possible  difference  In  the  case  of  Item  16 
(remembering  what  you  have  read  a  day  later),  the  only  Instance  out 
of  the  eighteen  where  the  mean  of  Blology^tudents  was  the  larger 
of  the  two  means. 

Illinois,  Form  B  (See  Table  18):    Are  some  study  goals  or 
strategies  perceived  to  be  more  difficult  to  achieve  or  Implement 
by  students  in  one  subject  area  as  opposed  to  the  other?   The  mean 
responses  of  Biology  students  exceeded  that  of  History  students  in 
thirteen  Instances  out  of  the  eighteen.    The  largest  difference, 
however,  between  the  mean  responses  associated  with  any  one  Item 
is  .3512  or  12%  of  the  greatest  possible  difference.  This 
difference  occurred  in  response  to  Item  3  (understand  difficult 
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.  '      words),  the  mean  of  Biology  students  the  larger  of  the  two.   The  ' 
^       difference. decreased  to  all  but  1%  In  the  case  of  Item  17  (remember 
what  you  have  read  a  week  laterU  the  mean  of  History  students^  - 
larger  than  that  of  Biology  students.   As  reported  above,  Item  IZ^ 
Is  associated  with  the  largest  overall  mean  response.    With  respect 
to  similarities  between  subject  areas,  85%  of  the  Biology  students 
and  81«  of  the  History  students  Indicated  that  remembering  what 
you  have  read  a  week  later  Is  "sometimes  difficult"  or  "very 
difficult."    In  response  to  Item  19  (See  Table  24),  11.9%  of  the 
Biology  students  as  compared  to  4.9%  of  the  History  students  reporte 
as  one  additional  difficulty  the  fact  that  the  text  Is  boring. 
Trends  Withlh  and  Across  Gender 

Texas,  Form  A  (See  Table  19):   Are  some  study  goals  y 
;  strategies  perceived  to  be  more  difficult  to  achieve  or  Implement 
[  by  one  sex  as  opposed  to  the  other?   The  mean  of  mal es  exceeded 
'  that  of  females  on  sixteen  of  the  eighteen  Items.    The  largest 
difference  between  the  means  on  any  one  Item  Is  .6471  or  16.1% 
of  the  g^^eatest  possible  difference.    This  dmerence  occurred  In 
response  to  Item  16  (remembering  what" you  have\<;ead  a  day  later), 
the  mean  of  males  exceeding  that'of  females.    A  similar  difference 
occurred  In  response  to  Item  18  (concentrating  as  you  read),  36% 
of  the  males  and  59%  of  the  females  reporting  either  "some 
difficulty"  or  "a  lot  of  difficulty."   The  difference  between 
means  decreased  to  46%  In  the  case  of  Item  11  (answering  questions ^ 
or  completing  activities  the  teacher  has  provided),  53%  of  the 
males  and  57%  of  the  females  reporting  "rarely  any  difficulty" 
or  "never  any  difficulty." 

Illinois,  Form  B  (See  Table  20):    Are  some  study  goals  or 
strategies  perceived  to  be  more  difficult  to  achieve  or  Implement 
bv  one  sex  as  opposed  to  the  other?   The  mean  response  of  males 
exceeded  that  of  females  in  ten  instances  out  of  the  eighteen. 
The  largest  difference  between  the  means  on  anV  one  item  occurred 
in  response  to  item  9  (recall  something  you  already  know  that  will 
relate  to  what  you  are  reading),  the  mean  of  females  exceeding 
that  of  males.    This  difference  is,  however,  only  .2243  or  7.4% 
Ql  the  greatest  possible  difference.    The  difference  between  mean 
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responses  became  as  small  as  .0019  or  6%,  .when  in  response  to 
item  5  (outline  the  Information  In  the  chapter),  48%  of  the  mal 
and  45%^  of  the^femalBS  SffTected  eiglier  "hardly  ever  d1  f f IcuTt " 
or  "never  difficult,"  and  the  remaining  52%  of  the  males  and 
55%  cif  the  females  selected  either  "sometimes  difficult"  or 
"very  difficult." 


IV,   with  Respect  to  Content  Area  Teachers,  What- Instructional 
Focus  and/or  Stra^les  do  High  School  Students-Cons l^r 
Important?  ' 

Overall  Trends 

•  There  were  large  differences  In  high  school  students  . 
perceptions  of  the  worth  of  Instructional  activities 
associated  with  the  use  of  textbooks.    The  Instructional  , 
activities  that  students  Jdentlfled  as  most  Irpportant  for 
teachers  to  do  were  the  foil  owing:  (a)  Identifying  which  Ideas 
should  be  remembered;  (b)*rev1ew1ng  the  chapters  before  a 
test;  (c)  relatjjng.  new  Ideas  to  Ideas  the  student  already 
knows;  (d)  teaching  students  to  Identify  Important  Ideas; 

(e)  providing  questions  to  guide  students'  reading; 

(f)  explaining  difficult  vocabulary;  (g)  using  a  textbook 
which  Is  more  Interesting  to  read;  (h)  providing  students 

V  with  time  In  class  to  read;  (1)  discussing  Information  not  ^ 
\    covered  In  the  chapters;  (j)  providing  an  outline  or 

overview  of  the  chapters;  and  (k)  providing  students  with 
time  In  class  to  get  together  and  discuss  Ideas.  Among 
the  suggestions  students  deemed'-as  leas't  desirable  were 
the  following  :    (a)  use^a  textbook  that  Is  easier  to 
read;  (b)  spend  time  teaching  study  skills;  (c)  allow 
, students  to  read  a  textbook  on  their  own  rather  than  . 
making  reading  assignments;  (d)  spend  time  teaching  study 
skills,  and  (e)  stop  using  the  textbook  altogether. 

•  Across  subject  areas,  there  was  little  variation  In  student 
recomnendatlons  regarding  Instructional  activities  and 
suggestions.    What  students  Identified  as  Important  for 
history  classrooms  closely  corresponded  to  thoiir 
suggestion^  for  biology  classrooms.    Noteworthy,  however, 
was  the  tendency  of  biology  students  to  support  assigning 
additional  activities  to  help  students  understand  new  Ideas. 
History  students  supported  more  time  to  read  the  text  on 
their  own  than  their  biology  counterparts..  Also,  across 
their  free  responses^j  the  most  cited  suggestion  made  by 
students  was  the  Inclusion  pf  more  films  In  history  class. 
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•   Across  male  and  female  students,  there  were  very' few 

differences  in  terms  of  the  instructional  activities  they 
'  tended  to  support.   That  is,  what  males  and  females  deemed 
as  important  was  consistent  with  the  activities  described 
r'       .for  all  students. 


Discussion  of  results  ' 

niinois.  Form  B  (See  Tables  21A  and  21 B);    Do  high  school 
students  tend  to  consider  sortie  instructional  focuses  ahd/br 
strategies  more  important  than  others?   The  most  frequently  chosen 
response  option  \^aried  across  items  more  in  Subsection. IV  than  in 
any  of  the  other  three  subsections.    While  students  "agreed"  that 
an  instructi.orial  strategy  was  important  to  iiplement  in  thirteen 
out  of  the  twenty-one  instances  and  "strongly  agreed"  in  three, 
they  "disagreed"  in  four  instances  and  "strongly  disagreed"  in  one. 
Those  items  for  which  the  most  frequently  chosen  response  was 
either  of  the  latter  two  categoreis  include:    item  11  (let  me  read 
-    'the  text  for  myself  instead  of  making  reading  assignmentis),  16 
.     (spend  time  teaching  reading  skills^),  17  (spend  time  teaching  study 
.skills),  18  (use  a  textbook  which  is  easier  to  read),  and  21  (not 
use  the  textbook  at  all).    The  difference  between  the  largest  and 
smallest  mean  responses  is  1.8734,  or  62%  of  the  greatest  possible 
•     difference  between  means..  The  distribution  tends  to  be  skewed 
'   in  the^direction  of  "agreement"  as  opposed  the  "disagreement"  since 
jwith  respect  to  over  half  of  the  items  at  least  60%  of  the  students 
/^TelecS^ted  either  "agree"  or  "strongly  agreell  while  no  more  than  25% 
'  >-iJ    selectef~*di4agr^e"  or  "strongly  disagree. 

WhatlHnltructionaT  focuses  and/or  strategies  do  high  school 
students  consider  Important?   As  implied  above,  well  over  half  of  » 
the  Strategies  are  considered  important  by  at-Heast  60%  of  the 
students.    Examining  just  response  option  4,  two  particular 
strategies  out  of  the  twenty-one  are  apparently  considered  very 
important;  that  is ,  71%  of  the  students  "strongly  agreed"  with 
,  item  2  (go  over  the  chapter  in  class  before  a  test)  and  similarly, 

69. 7%-^'^trong1y  agreed"  with  item  3  (tell  me  which  ideas  in  the 
Chapter  I  should  remember).    In  addition,  items  2  and  3  are 
associated  with  the  two  smallest  standard  deviations  of  the 
:  y        twenty-one.  When  asked  on  item  22  (see  Table  24)  to  describe 

-anything  else  the  teacher  might  do  to  help  students  study  a  chapter 
in  their  textbook,  anything  not  Otherwise  mentioned  in  the  forced 
choice  portion  of  the  survey,  2%  of  the  students  suggested  the  use 
or  more  frequent  use  of  quizzes  and/or  practice  tests. 
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What  instructional  focuses  and/or  strategies  are  not  considered 
important  by  high  school  students?  Over  50%  of  the  students  either 
"disagreed"  or  "strongly  disagreed"  that  f(ive  of  the  instructional 
strategies  are  important ,  those  associ ate^wi th  i terns  1 1  ( 1  et  rne 
read  the  text  for  n\yself  instead  of  maKfng  reading  assignments), 
16  (spend  time  teaching  reading  skills)^  17  (spend  time  teaching 
study  skills),  18  (use  a  textbook  which  is  easier  to  read),  and 
21  (not  use  the  textbook  at  all).    The  largest  percentage  occurred 
in  response  to  item  21 ,  84%.;  however,  the  standard  deviation 
aissociated  with  this  item  is  the  largest  of  the  twenty-one. 
Trends  Within  and  Across  Subject  Areas 

Illinois,  Form  B  (See  Tables   22A  and  22B):    The  mean  responses 
of  Biology  students  exceeded  that  of  History  students  in  eleven  out 
of  the  twenty-one  instances;  the  mean  of  History  students  exceeding 
that  of  Biology  students  in  the  remaining  ten.    The  largest 
difference  between  the  two  means  on  any  one  ite"m  occurred  in 
response  to  item  11  (let  me  read  the  text  for  myself  instead  of 
making  reading  assignments) ,  where  75%  of  the  Biology  students  as 
compared  to  50%  of  the  History  students  indicated  that  the 
strategy  was  not  important  while  25%  of  the  remaining  Biology 
students  and  50%  of  the  History  students  either  "agreed"  or 
"strongly  agreed"  that  the  strategy  was  important.    This  difference 
amounted  to  15%  of  the  greatest  possible  difference  between  means. 
Item  18  (use  a  textbook  which  is  easier  to  read)  resulted  in  the 
smallest  difference  between  means,  only   4%  of  the  greatest 
possible  diffisrence.    In  response  to  item  22  (see  table  24) 
suggestions  mentioned  by  students  from  only  one  subject  area  ^ 
include:    show  more  films,  reported  by  4.9%  of  the  History  students; 
include  field  trips,  1.5%  of  the  History  students;  provide  notes, 
2.1%  of  the  Biology  students;  require  more  lab  work  and  more.  ^ 
projects,  both  reported  by  1.4%  of  the  Biology  students. 
Trends  Within  and  Across  Sexes 

Illinois,  Form  B  (See  Tables  23A  through  23D):    The  mean 
response  of  female  students  exceeded  that  of  male  students  on 
fourteen  of  the  twenty-one  items.    The  largest  difference  between 
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the  means  on  any  one  .item  is  .2503  or  Q%  of  the  greatest  possible 
difference.   This  difference  occurred  in  response  to  item  13  (assign 
additional  activities  to  help  me  understand  the  .ideas  in  the 
chapter),  where  the  mean  of  females  exceeded  that  of  males,  72%  of 
the  females  and  59%  of  the  males  " agreeing*^  or  "strongly  agreeing" 
that  assigning  a4ditional  activities  is  an  important  instructional 
strategy.'^  The  smallest  difference  between  means,  57%  of  the 
greatest  possible  difference,  occurred  on  item  1,  where  70%  of  the 
females  and  68%  of  the  males  considered  it  important  that  teachers 
spend  more  time  explaining  the  chapter  before  students  read  it. 
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V.    What  Are  Teachers'  Perceptions  of  the  Typical  History  and 

Biology  Student's  Responses  to  the  Survey 
Overall  Trends  » 

•    In  general  the  teachers'  perceptions  of  the  students— 
what  students  do,  recommend  and  the  difficulties  which 
they  incur—coincided  with. the  responses  obtained  from 
the  students  themselves.   However,  some  significant 
exceptions  did  occur.    Teachers  overestimated  the  extent 
to  which  students  use  selected  strategies.    They  failed 


Discussion  of  the  Results 

For  purposes  of  comparing  the  teacher's  responses  with  those 
of  the  students,  the  responses  of  both  groups  to  each  survey  item 
were  averaged,  r^anked  and  correlated.    For  example,  the  average 
across  the  set  of  teacher's  responses  for  a  single  item  might  be 
3.5,  for  another  2^5,  for  another  4.0,  and  so  on.    By  comparing 
the  scores  for  the  items  within  each  subsection  a  rank  order  of 
items  was  derived.    These  rankings  were  then  cbmpared  with  those 
acquired  from  the  students  for  the  same  items.    The  following 
discussion  describes  our  comparisons  of  the  rankings  for  th^  fouir 
subsections  of  the  questionnaire.  V 

Part  One  of  the  survfey  included  seventeen  items  which  V 
addressed  the  frequency  with  which  students  made  use  of  selected 
study  skills  and  resoruces.    With  very  few  exceptions,  the  rankings 
based  upon  the  teachers  responses  coincided  with  those  of  the  -/^ 
students.    The  strategies  which  students  reported  that  they^-ii«Ki 
more  frequent  were  identical  with  those  the  teachers  identified. 
Also,  with  only  one  major  exception,  the  strategies  which  students 
infrequently  enlisted  coincided.    The  notable  exception  was  that 
teachers  overestimated  the  extent  to  which  the  typical  student  in 
either  their  history  or  biology  class  referred  to  any  book  other 
than  their  textbook. 


to  identify  some  text  characteristics  that  the  students 
themselves  deemed  as  impediments      to  learning.  They 
disagreed  With  the  student's  perception  of  their  ability 
to  use  selected  strategies;  and  also  how  students  would 
perceive  the  worth  of  selected  instructional  activities. 
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Part  Two  of  the  survey  included  twelve  items  intended  to  . 
assess  those  text  characteristics  which  students  deemed  as  most 
problematic.    Again,  with  only  a  few  exceptions,  the  projections 
offered  by  the  teachers  were  consistent  with  the  student's  actual 
responses.    The  most  notable  discrepancy  was  an  underestimation  by 
teachers  of  the  concern  expressed  by  students  for  more  examples. 

Part  Three  of  the  survey  included  eighteen  items  addressing 
students'  perception  of  their  own  strengths  and  weaknesses.  While 
most  of  the  teachers'  projections  coincided  with  the  responses 
offered  by  the  students,  there  was  a  tendency  by  teachers  to 
overestimate  the  ability  of  students  to  use  certain  of  the  study 
skills  to  underestimate  others.    For  example,  teachers  overestimated 
students'  perceptions  of  their  ability  to  remember  what  they  had 
read,  to  prepare  for  exams  and  to  identify  important  ideas. 

Alternatively,  teachers  underestimated  what  students  perceived  as. 
their  ability  to  adapt  reading  rate  in  response  to  purpose  and  the 
difficulty  level  of  the  material . 

Part  Four  of  the  survey  wa|^ concerned  with  students' 
perceptions  of  how  important  selected  instructional  activities 
were.    For  most  of  the  activities  listed,  the  teacher's  ranked 
responses  agreed  with  those  offered  by  the  students.  However, 
there  were  several  activities  where  disagreement  occurred.  For 
example,  teachers  did  not  rank  as  important, as  student's  did  the 
discussion  of  information  not  covered  in  the  chapter.    In  contrast 
teachers  deemed  more  worthwhile  than  did  the  students  the  teaching 
of  reading  skills,  the  teaching  of  study  skills  and  allowing 
students  to  read  the  text  on  their  own  rather  than  making  reading 
assignments. 
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Final  Conment 

Results  of  our  survey  Indicated  that  content  area  classrooms 
or  the  whole  continue  to  be  oriented  around  the  use  of  a  single 
textbook.   This  has  made  success  In  the  content  area  nearly  ' 
synonymous  with  the  ability  to  learn  from  the  one  textbook  provided. 
As  unfortunate  as  It  may  seem,,  this  situation  together  with  the 
bulk  of  required  reading,  the  demand  for  Intensive  study,  and  the 
emphasis  upon  Independent  learning,  make  It  Imperative  that  ' 
Students  find  a  way  to  penetrate  what  Hahn  (1967)  refers  to  as  the 
"paper  curtain."   The  present  survey  results  provide  isaSrBl  sugges- 
tion as  to  why  this  may  be  the  case.    The  data  suggests  that  the 
study  techniques  students  enlist  represent  a  restricted  repertiore 
of  goals*  strategies  and  resources.    Furthermore,  the  student's 
level  of  facility  with  these  strategies,  with  the  texts  themselves 
and  with  tfie  instructional  environment  may  act  as  impediments  to 
learning.   While  suggestions  must  be  somewhat  speculative,  given 
that  self-report  nature  of  the  data,  they  represent  hypothesis 
that  can  be  explored  in  collaboration  with  more  systematic, 
objective  and  detailed  analysis  as  texts,  readers,  and  instruction. 
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III 

CHARACTERS! ICS  OF  TEXT 
(with  S.  Ulerick  and  K.  MargoTis) 


PART  I.    A  METHOD  FOR  DESCRIBING  TEXTBOOK  LANGUAGE 

Keeping  In  mind  our  general  goal  of  gaining  Insight  into  how 
students  learn  from  their  textbooks,  we  faced  a  major  task  of 
describing  the  language  found  1n^  textbooks.   One  parameter  we  might 
have  used  Is  the  ubiquitous  readability  formula.    While  the  notion 
of  measuring  the  difficulty  of  written  materials  dates  back  centuries, 
most  studies  have  depended  almost  solely  on  readability  formulas 
(Aukerraan,  1972;  Klare,  1974-75).    As  Beldon  (1962)  noted,  the 
appearance  of  Gray  &  Learv's  What  Makes  a  Book  Readable  In  1935  gave 
impetus  to  work  on  adult  and  upper-fechool  level  readability  problems, 
the  Lorge,  Yoakam,  Flesch,  and  Dale  &  Chall  being  among  the  many 
readability  formulas  that  emerged. 

While  readability  formulas  have- been  valuable,  they  have  also 
encouraged  a  restricted  view  of  what  makes  a  text  comprehensible. 
Their  analyses  have  generally  been  at  a  word  or  sentence  level  and 
have  failed  to  address  those  characteristics  of  text  that  extend 
beyond  the  sentence  or  those  features  such  as  the  author's  reason 
for  writing  that  appear  to  be  Implicit  but  are  no  less  potentially 
-Important  factors  In  determining  comprehensibll Ity.  Furthermore, 
as  Horn  (1937)  suggested,  referring  to  social  studies  material ,  even 
If  materials  were  written  In  clear,  nontechnical  language,  the  very 
nature  of  the  concepts  would  make  the  material  difficult  to  under- 
stand. 

For  these  reasons,  we  rejected  the  construct  of  readability  as 
it  has  been  used  and  searched  for  a  way  of  describing  content-area 
textbooks  that  would  capture  the  unique  conceptual  demands  It  makes 
on  readers.    We  considered  how  textbooks  are  used  In  the  classroom. 
As  part  of  that  setting,  textbooks  are  Intended  to  teach  students 
concepts,  to  have  them  consider  knowledge,  systems  of  Information  and 
ways  of  knowing  as  veeJdlcal  transactions  with  the  world.    Thus,  we 
needed  to  describe  what  It  was  they  were  expected  to  learn.  We 
needed  a  system  that,  like  the  students,  would  Identify  the  essential 
Information  that  the  textbook's  author  Intended  to  present  In  his  or 
her  prose.    And,  although  the  major  clues  to  the  author's  Intended 
message  are  the  actual  words  used,  the  message  _l£  the  Ideas  and 
relationships  between  Ideas  that  the  author  hoped  students  would 
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learn  about  the  topic  presented. 

In  pursuing  our  goal  of  describing  the  text  that  students  were 
expected  to  learn,  we  considered  available  text  analysis  systems. 
There  were  several  that  recommended  themselves  by  virtue  of  their 
flexibility  In  representing  4^scourse  and  of  their  respected  empirical 
traditions.    For  example,  the  analysis  systems  of  Kintsch  (1974;  Turner 
&  Greene,  1977;  Kintsch  &  Van  Dijk,  1978),  Meyer  (1975)  and  Frqderlksen 
(1972,  1975)  have  been  used  extensively  to  describe  Information  texts. 
A]]  three  have  the  potential  of  Identifying  and  classifying  the  "pieces" 
of  a  text  (bigger  than  a  word,  smaller  than  a  sentence,  usually  Identi- 
fied as  a  proposition;    Fillmore,  1968)  as  well  as  describing  whole- 
text  patterns  of  propositions.    However,  where  these  systems  were  most 
useful  In  the  description  of  the  ongoing    process  by  which  as  reader 
takes  the  print  on  the  page,  constructs  a  meaning  for  It,  and  learns 
the  text,  we  needed  a  system  that  would  describe  what  a  reader  Is 
expected  to  learn  from  a  text.    Although  It  Is  theoretically  crucial 
to  determine  how  readers  process  print.  It  Is  also  Important  to  focus 
on  the  more  permanent  changes  In  readers  that  might  occur  as  they 
encounter  print.    Furthermore,  Instructlonally,  this  Is  a  major  goal: 
to  have  students  not  only  understand  what  they  read  but  change  their 
conceptions  of  the  world  as  a  result  of  their  contact  with  an  autnor's 
(or  teacher's)  message. 

^    Thus,  we  developed  relational  mapping,  a  system  of  text  analysis 
particularly  suited  to  describing  the  concepts  and  relationships 
between  concepts  that  authors  Intend  and  that  readers  should  learn 
when  they  approach  Informative  discourse  In  an  Instructional  setting. 
The  system  borrows  from  Armbruster  and  Anderson  (1979)  the  same  limited 
list  of  relationship  categories  and  the  same  graph-s^ymbol  1c  represen- 
tation of  text.    The  maps  we  produce  as  a  first  step  In  text  descrlp;^-^ 
tlon  reflect  an  (Underlying  assumption  that  the  author  Intended  every- 
thing stated  about  a  topic  to  form  a  coherent  whole.    From  tKe  ofaphlc 
map,  we  derive  relationship  propositions  that  are  then  rated  for 
expl  1c1tn<3ss  and  embeddedness.    These  propositions  can  be  used  In  a 
number  of  ways,  such  as  scoring  recall  protocols,  deriving  test  question 
-and  preparing  students  to  learn  from  the  text. 

In  the  next  three  sections^  we  describe  In'detall  the  parts  and 
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process  of  relational  mapping  and  Its  associated  problems  and  promise. 

Relational  Mapping 

The  Pieces 

Thfere  are  two  major  and  independently  useful  products  of  relational 
mapping,  the  map  and  the  list  of  relationships  propositions.    The  map 
Is  a  graphic  representation  of  the  concepts  and  relationslps  that  we 
as  text  analysts  identify  as  the  Intended  message  of  the  author.  It 
Is  constructed  by  Identifying  the  concepts  (ideas,  facts,  topics)  In 
the  text  and  tten  graphing  (mapping)  the  relationships  that  hold  the 
concepts  togelUr  to  form   a  coherent  whole.    Concepts  are  somewhat 
loosely  defined  in  the  system  and  their  scope  varies  with  the  level 
of  detail  needed  for  research  or  Instructional  purposes.    In  a  very 
detailed  map,  for  example,  concepts  may  be  single  adjectives  or  pre- 
positional phrases  related  as  properties  of  a  superordinate  concept. 
In  more  general  mapping,  whole  sentences  and  sometimes,  paragraphs  or 
units  may  serve  as  concepts.    The  degree  of  specification  of  a  map 
depends  upon  what -It  Is  that  the  researcher  or  teacheff  expects  the 
learner  to  take  away  from  the  text. 

Three  major  assumptions  guide  the  mapping  process.    The  first, 
alluded  to  earlier.  Is  that  the  t^xt  forms  a  coherent  discussion  of 
the  topic.    That  Is,  we  make  the  assumption  that  everything  the  author 
states  Is  somehow  relevant  and  related  in  some  way  to  the  topic.  This 
assumption  becomes  the  basis  for  Inferences  we  make  and  for  Implied 
concepts  and  relationships  we  bring  Into  the  map  to  makeall  Its  parts 
cohere. 

The  second  assumption  Is  that  the  concepts  presented  by  the  author 
are  organized  and  are  subsumed  (embedded)  by  their  relationship  to 
,  the  topic  of  the  text.    Thus  the  graphic  representation  of  the  text 
shows  by  Its  structure  the  set  membership,  property,  comparison  and 
process  relationships  that  hold  the  concepts  together.    The  first  and 
second  assumptions  work  together  when  we  as  text  analysts  find  a  place 
In^he  developing  map  for  every  concept  presented  by  the  author. 

The  third  assumption  Is  that  a  relatively  limited  set  of  relation- 
ship types  will  be  adequate  In  representing  all  of  the  ways  ttf  which 
two  concepts  can  be  related  to  each  other  In  Informative  discourse. 
The  relationship  types  come  from  rhetoric  and  Identify  Concept^ A  as 
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deflnlnQ  Concept  B,  as  being  a  property  of  Concept  Bt  as  betng  an 
exampl e  of  Concept  B,  as  being  similar  or  not  similar  to  Concept  B,  as  ^ 
being  greater  than  or  less  than  Concept  B,  as  occurring  before  Concept 
B,  or  as  causing  Concept  B.    The  relationship  types  as  well  as  the 
graphic  symbols  used  to  represent  the  relationships  are  presented  In 
Figure  3.1 •  t 

Note  that  we  occasionally  group  the  "similar,"  "not  similar"  ^ 
"greater  than,"  "less  than"  relationships  and  call  them  comparison 
relatt^hlps.    Similarly,  we  refer  to  the  temporal  and  causal  relation- 
ships as  process  relationships  since  they  both  Indicate  the  steps  In 
a  chain  of  events  (or  reasoning).    The  definition  and  property  relation- 
ships are  also  closely  related  as  giving  characteristics  of  concepts 
while  the  example  relationship  gives  set  membership  Information. 

The  last  assumption  described  above,  forces  the  text  analyst  to 
make  a  certain  kind  of  categorical  decision  about  each  potential 
relationship  identified  in  a  text.    Any  relationship  between  two  con- 
cepts must  be  one  ofSj^e  nine  types  possible  within  tiie  system.  The 
three  assumptions  of  mapp^ftg  working  together  lead  the  text  analyst  to 
show  the  structure  and  embeddedness  of  ideas  within  a  text  in  terms  of 
one  or  more  of  nine  possible  relationship  types. ^  Thus,  Concept  A  may 
cause  Concept  B  and  that  relationship  between  those  two  concepts  may 
be  a  property  of  an  example  of  the  main  topic  of  a  text. 

Once  a  map  of  a  text  is  produced,  the  list  of  relationship  pro- 
positions can  be  derived.    This  simply  Involves  hiaking  an  explicit 
verbal  statement  of  how  Concept  A  is  related  to  Con6^t  B.  Each 
relationship)  proposition  is  then  compared  to  the  original  text,  and  a 
decision  is  made  about  how  explicit  the  author  was  in  indiqating  the 
concepts  and  the  relationship  found  in  the  proposition.    Finally,  the 
level  of  embeddedness  of  each  relationship  proposition  is  determined 
by  counting  the  number  of  steps  that  are  needed  to  connect  it  back  to, 
the  main  topic  of  the  text.    Thus,  the  relationship  propositions  yield 
.three  products,  type  of  relationship,  rated  explicitness  and  level  of 
embeddedness.    In  the  next  section,  we  describe  the  processljy  which  we 
arrive  at  a  map  of  a  text  and  derive  Its  associated  list  of  relation- 
ships  propositions. 
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Relationship  Types  Recognized  by  Relational  Mapping 


Relationship  Type 
Def tnfttdrt 


Property 


Exampl e 


/ 


Happing  Synrbol 


Concept  A 


DEJ:  Concept  B 


Con<!ePt  a 


or 


Concept^  A 


Concept  6 


Concept  A 
I ConceptB  I 


similar 


4^ 


Not  SImJ l§r 


Iconceot  Ag^  ConceptB 


ConceptA  ^Concept^ 


L^ss  Than 

TeriHJoral 
Causal 


\ 


Concept  A>ConcepT^B 


Greater  Than 

.  or 

Concept  A  . 

> 

;onceptB 

property 

property 

Concept  A  <  Concept  B 


Conceot 

A->Conc€ptB 

Iconceot 

A'=^ConceptB  [ 
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The  Process  /  '  * 

The  map>    In  mapptfig  a  text,  we  begin      reading  over  the  whole  V, 

passage,  keeping  fn  mind  the  level  of  detail  that  the  map  will  need  to 

reflect  g^lven  oiir  established  purpose.    The  following  text,  extracted 
from^hlgh  sdrool  level  biology;  textbook^  will  serve  to  lllustra^ 

the  procesj&^f  mapping.                    ^             '     '  ^ 

SHARKS^  EAIS,  H^d  SKATES  ^ 

Sharks,  my^,  and  ehatee  j^elang  to  ,the  olaae  , 
Chortdiri^hth^        iMe  mecaie  "aartilage  fiahea. "   It  ia  ^ 
thought  that  they' developed  early  in  the  Devonian  period* 
Of  the  fiahea  tjfat  lived  in  the  .ancient  aeaa,  many  , 
aartilage  fiahea  have  survived  retat'^elp  ^inohanged  in 
great  monbers* 

Sharks  are  similar^  to  trwa  fiahek^  in  many  waya*  .  But 
they  have  certain  differenoea)  which  place  them  in  a  aeparate  • 
olaaa.    Sharka  have  plagpid  agale^  which  ^taoe  the'aame  origin  • 
as  the  aharkJa  teeth ^   The  mouth  ia  a  horizontal  alit  on  the  ^ 
ventral  aide  of  the  headk    JTie  jozja  ahark  are  i/ery 

atrong  and  lined  with  razor-aharp,  pointed  teeth.    The  teeth 
are  placed  in  several  vme.  \  VH^  a  tooth  is  lost,,  another 
one  may  move  forward  to.  replace  it.    The  tdeth  slant  backward 
to  hold  the  food  securely*  in  the.ihauiK    This,  oombined  with 
great  strength,  makes  the  shark  a  fearsome  hunter. 

Water  enters  the  mouth,  where  it  passes  over  tkb  gills 
an  either  side  of  the  head.    The  water  is  then  forced  out 
through  separate  .pairs  of  gill  slit&.    The  gills  are  the 
respiratory  organs  of  the  fish]        *  \ 

As  the  map  develops,  the  three  assumptions  described  above  guide 
the  decisions  we  make  in^eprefenting  the  text:    1)  tifie .relationship 
between  any  two  concepts  must  be  one  of  the"  nine  types  recognized  by  ^ 
the  system;  2)  all  concepts  must  be  related  through  embedding  to  the 
main  topic;  and  3)  concepts  iind  relationships,  even  "ttiough  not  men- 
tioned explicitly  by  ttje  author,  must  appear  in. the  map  if  they  are 
needed  to  make  the  whole  text'  coherent. 

After  reading  the  text,  our  first'  task  if  to  identify  tte  main 
topic  of  the  passage.    This  is  not  always  an  obvious  choice.    In  the 
passage  presented  above,  there  are  several  pc^ibil ities.    One  is  the 
heading  which  Rroclaims  that  the  text  will  be  about  "Sharks,  raj^ -and  • 
skates."    The  first  sentence  tells  us  that  these  three  organisms  belong 
to  a  superordinate  class  "Chondrichthyes"  and  characteristics  of  the 
class  as  a  whole  are  then  provided.    Perhaps,  "Class  Chondrichthyes" 
is  the  topic.    But  then,  most  of  the  text  is  a  discussion  of  sharks  and 


perhaps  by  virtue"  of  the  extent, of  discussion,  "sharks"  shoujd  be 
considered  the  topic. 

We  *have  found /that,  two  ^guidelines  can  be  used  to  establish  the* 
topic  of  a^  text.    The  first  is  primacy  in  the  presentation  of  concepts 
in  thf  text.    As  much  as/possible,  in  mappingj  we  try  to  adhere  to 
the  serial  order  of  concepts  presented  and  thus,  we  often  identify  an 
"earl y*V concept  as  tlj6  topic  of  a  text.    The  second  guideline  applied 
in  situations  where  two  concepts  vie  to  be  chosen  as  topic  but  one  is  " 
the  logical  superordinate  of  the  other.^  In  such  a  situation,  the 
jsuperordinate  term  autojnatically  becomes  the  topic.    One  'text  author 
claims  that  sharks,  rays,  and  skates  are  examples  of  the  class  "Chon- 
crichtfiyes,"  and  thisreby  rfiakes  thes^  concepts  subordinate  terms.  In 
this^case,  both  guidelines  are^  used  since  the- toncept  "Class  Chondrich- 
thyes"  not  only  represents  a  superordinate  term  but  also  occurs  near 
the  beginning  of  the  t^xt. 

The  mairr  topic  is  represented  graphically  by  v^riting  it  on  the 
map,  drawing  a  double  line  under  it,  and  placihg  a  large,  and  for  the 
moment,  empty  Ijox  around  it  (|te  Figure  3.2).    The  bo^  will  eventually 
be  filled  with  the  concepts  presented  in  the  rest  of  the  text,  all 
structurally  tied  in  some  fashion  to  the  main  topic. 

In  proceeding  through  the  text,  similar  decisions  are  made.  What 
is  a  concept?   How  is  it  related  to  other  concepts?   Where  does  it  go 
on  the  map?   These  questions  are  answered  simultaneously  with  the  selec- 
tion  and  placement  of  each  succeeding:  concept.    Revisions  of  the 
developing  map  are  often  necessary.    Consider  our  saropTe  text.    In  the 
first  paragraph,  the  author  has  presented  some  information  about  cTass 
Chondrichthves  as  a  group  of  fishes.    We  want  these  items  placed  close 
to  the  main  topic  in  the  map  and  subordinate  to  it.    (We  ignore  for  the 
moment  the  first  sentence.)    The  author  states  in  the  second  sentence 
"this  means  'cartilage  fishes.!"    We  make  the  inference  that  "this" 
refers  to  our  main  topic  and  we  take  the  word  "means"  as  a  marker  for 
the  relationship  of  definition.    As  the  next  concept  placed  on  the  map, 
we  write  below  the  double  line,"  DEF:  cartilage  fishes,"  and  draw  a 
line  across  the  map  underneath  the  definition. 

We  then  proceed  to  the  next  sentence  to  see  if  it  presents  concepts 


^  Figure  3;2 


Beginning  #f  Map  of  SarrfpTe  Text 


Figure  3.3 
Developing  Map  of  Sample  Text 


Class  ^fhondrichthyes 


DEF :  Carti 1 aqe  f i  shes 


thought  to  have  developed  early  in  Deyoni an  Period 


are  among  fishes  of  ancient  seas 


^  many  have  survived  relatively  unchanged  in -great  nimbers 


related  to  the  main  topic.    The  sentence  describes  when  the  cartilage 
fishes  probably  developed.    We  judge  this  information  to  be  a  property' 
or  descriptor  of  the  main  topi  a  and  perceive  ft  as  representing  just 
^one  instructional  concept.    Accordingly,  the  whole  sentence  is  mapped 
as  a^  property  of  class  ChOndrichthyes.    Evidently,  the  author  is  not 
willing  to  state  the  concept  as  a  fact  but  qualifies  it  with  "it  is 
thought  that."    This  qualifier  may  or  may  not  b?  instructionally 
important.    It  may  reflect  the  author  as  scientist   reverting  to  the^- 
careful  style  meant  for  other  scientists.    At  this  point,  we  choose 
to  include  it  in  the  map  but  only  as  part  of  the  same  instructional 
concept, it  qualifies. 

The  final  sentence  of  the  paragraph  is  more  complex  than  the 
preceding  .ones.    Two  more  properties  of  cartilage  fishes  are  presented 
they  lived  in  ancient  seas,  and  many  have  survived.    The  former  pro- 
perty 1s  actually  a  less  precise  restatement  of  the  information  about 
the  Devonian  period,  although  the  author  is  not  clear  on  this  equi-  _ 
valence.    Since  that  inference  is  not  essential  to  understanding  the 
text  af  a  coherent  whole,  it  is  not  mapped  as  such.    A  sophisticated 
readeri  might  also  infer  from  the  property  that  there  were  other  fishes 
in  ancient  seas.    This  inference  is  also  true,  but  again,  provides  a 
non-essential  elaboratio.n  of  the  content.    We  fefl  less  certain  that 
t^e  author  intended  for  students  to  derive  that  meaning.  .Therefore 
we  leave  it  but.    The  map  of  the  text  so  far  would  look  like  Figure 
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The  remainder  of  the  passage  is  concerned  solely  with  sharks  and 
their  various  characteristics.    ShaVks  are  related  to.  the  main  topic, 
class  Chondrichthyes  by  "belonging  to  it,"  along  with  rays  and  skates. 
Thus  we  pick  up  the  information  from  the  first  sentence  and-  indicate 
that  sharks,  rays,  and' skates  are  all  examples  of  the  class.  Examples 
are  mapped  as  concepts  enclosed  in  boxes  within  the  big  box  that 
represents  the  whole  text.    "Rays"  and  "skates"  become  one-word  boxes 
since  the  author  does  not  say  anything,  more  about  Ihem.    "Sharks,"  by 
contrast,  labels  a  large  box  to  be  filled  with  concepts  that  are 
related  specifically  to  sharks.    Figure  3.4  depicts  the  completed 
map  of  the  sample  texj;.  . 


We  would  like  to  make  a  few  more  comments  about  sections  of  the 
"shirks"  box  before  describing  other  aspects  of  relational  mapping. ^ 
Note,  first,  that  not  all  properties  have  equivalent  embedding.  The 
author  has  described  several  properties  of  sharks!  they  have  scales, 
.a  mouth,  jaws.    For  each  of  these,  additional  Information  Is  given. 
For  Instance,  the  jaws:  have  teeth  and  the  teeth  are  razor-sharp, 
pointed  arid  come  In  several  rows.    To  represent  these  properties  of 
properties,  we  Indent  successively  embedded  properties  to  show  which 
concepts  are  connected. 

\  Toward  the  end  of  the  second  paragraph,  the^ author  Includes  con- 
cepts that  are  related  temporally  and  causally.    The  temporal  relation- 
ship Is  cued  by  the  word  "when."    It  Is  shown  on  the  map  by  a  single 
arrow  (-^)  between  two  concepts.    After  one  tooth  Is  lost,  the  author 
Informs,  another  may  move  forward  to  take  Its  place.    First  one  event 
occurs  and  then  the  other.  ^ This  entire  relationship  Is  represented  ■ 
as  a  property  of  "teeth."    Relationships  of  causality  are  featured 
In  the  remainder  of  the  second  paragraph.    The  slant  of  the  teeth 
causes  food  tq  be  held  securely  and  this.  In  turn,  contributes  to 
making^  the  ishark  a  fearsome  hunter.    Causal  relationships  are  Indicated 
by  double  arrows         on  the  map. 

The  final  paragraph  of  the  text  presents  a^  special  problem.  It 
begins  with  the  phrase  "water  enters  the  mouth."    The  term  "shark" 
Is  not  used  and.  In  fact,  only  In  the  last  word  of  the  paragraph  do 
we  find  any  explicit  mention  of  fish.    "Mouth"  has  not  been  mentioned 
for  several  sentences.    How  then  is  this  section  of  the  text  to  be 
related  to  the  rest  if  we  are  to  assume  that  the  text  is  coherent? 
It  is  in.  such  a  situation  that  essential  Inferences  must  be  made.  In 
this  6ase  several  are  needed.    First,  we  assume  that  the  paragraph 
must  be  giving  more  information  about  sharks.    This  assumption  is 
based  on  another  assumption  we  make  about  text  that  if  a  major  topic 
change  were  occurringi  the  author  would  have  told  us.    By  default,  in 
this  case,  new  information  must  be  continuing  the  development  of  a 
previously  Introduced  topic.    Second,  we  irtfer  that  the  t^emporal  chain 
of  events  describing  the  flow  of  water  must  refer  to  some  feature  of 
property  of  the  shark.    The  property  needed  1s  one  that  can  serve  as  ^ 
a  superordinate  to  the  process  of  water  circulating  over  the  gills  and 
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Figure  3.4 
Final  Map  of  Sample  Text 
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gill. slits  of  the  fish.    What  that  superordinate  property  might  be 
becomes  clearer  In  the  last  sentence  when  the  author  states  "the 
gills  are  the  respiratory  organs  of  the  fish."    "Respiratory  organs" 
.  must  play  a  role  In  a  process  and  a  process  label  Is  exactly  what 
we  need  as  a  superordinate  for  this  section  of  the  map.    Thus  we 
infer  that  sharks  have  a  respiratory  process  and  we  tie  the  final 
paragraph  to  the  map  through  this  inferred  property  of  sharks.  The 
dashed  lines  around  the  concept  "respiratory  process"  Indicate  that 
it  Is  Implied  rather  than  explicitly  stated  In  the  text. 

Thus,  we  complete  our  map  of  the  sample  text.    Two  further  notes 
need  to  be  added  to  expl icate  some  conventions  we  have  found  useful. 
When  describing  a  text  at  a  relatively  detailed  level,  we  make  it 
a  practice  to  render  on  the  map  any  concept  of  relationship  that  the 
author  mentions  explicitly,  even  though  occasionally,  this  may  marr 
the  Ideal  structure  being  developed.    Also,  we  have  used  the  "not 
similar"  symbol  (^)  whenever  the  author  states  explicitly  or  Implies 
a  contrast  relationship  by  the  use  of  connectors'  such  as  "but"  or 
"however." 

The  process  so  far  described  yields  a  graphic  summary  of  the 
concepts  and  relationships  that  we  as  text  analysts  perceive  the 
author  to  be  communicating  to  potential  learners.    As  such,  the  map 
could  be  used  as  a  glorified  outline  for  Instructional,  purposes.  In 
text  descr1l)t1on  research,  the  map  Is  particularly  compelling  in  Its 
display  of  the  pattern  of  Ideas,  the  extent  of  elaboration  of  par- 
ticular sub-topics,  and  the  types  of  connections  that  the  author  Is 
inviting.    However,  by  Itself,  the  map  Is  dlfflcult^to  use  In  describing 
what  readers  actually  learn  from  the  text.    To  that  end,  we  need  the 
list  of  relationship  propositions. 

The  relationship  1 1st.    Every  concept  on  the  map  Is  tied  to  some 
other  concept  by  a  relationship.    The  list  of  relationship  propositions 
Is  derived. by. a  simple  and  mechanical  process  of  verbalizing  what  the 
map  presents  graphically.  Concept  A  —  Relationship  -  Concept  B.  The 
Tist  presented  In  Table  3.1  Is  derived  from  our  "Sharks,  rays  and 
skatgs"  passage. 

.'Although  the  process  of  deriving  the  list  Is  relatively  mechanical, 
we- have  found  a  number  of  conventions  necessary  when  dealing  with 
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certain  mapping  problems: 

1.  The  definition,  or  property,  or  example,  or  effect  In  a 
causal  relationship,  or  second  event  In  a  temporal  rela- 
tionship^ Is  always  identified  as  Concept  B  In  the  list. 
Note  that  we  have  used  the  verb  "precedes"  to  indicate 
the  temporal  relationship.  ; 

2.  Whole  relationship  propositions  may  serve  as  concepts  In  a 
later  propostlon:  "for  e)fample,  Proposltfons  #9,12,24,28, 
and  33  In  the  list  shown  In  Table  3.1  represent  such  cases. 
Proposition  #12  Is  particularly  complex.    It  restates 
two  properties  af  sharks  mentioned  in  previous  proposi- 
tions, one  of  which  (#  11}  causes  the  shark  to  be  placed 
In  a  separate  class.    These  two  properties  are  now  con- 
cepts In  Proposition  12  and  are -related  to  each  other  by 

a  contrast  ("is  not  similar 'to")  relationship. 

3.  The  order  in  which  propositions  are  listed  Is  not  crucial. 
Usually,  all  properties  and  examples  of  a  concept  are  given 
before  that  concept  is  then  tied  by  a  comparison,  temporal 
or  causal  relationship  to  another  concept! 

4i    Occasionally,  a  temporal,  causal  or  comparative  relationship 
co-exists  with  property  relationships.    In  such  cases,  a 
vertical  line  appears  on  the  map,  separating  the  concept 
that  Is  a  property  of  a  main  concept  from  the  temporal, 
causal  or  comparative  symbol.    Note  the  differences  in  the 
sections  of  the  map  (Figure  3.4)  relevant  to  the  following 
excerpt  from  our  sample  text,    "...when  a  tooth  is  lost, 
another  moves  forward  to  replace  It.    The  teeth  slant 
backward  to  hold  the  food  securely  In  the  mouth.  This, 
combined  with  great  strength,  make  the  shark  a  fearsome 
huntar."    The  relevant  propositions  are. numbers  24 
through  31.    The  first  sentence  depicts  a  fact  or  concept 
abou^  teeth.    That  fact  Is  a  property  of  teeth  (see  Prop. 
24).    The  concept  Itself  breaks  down  Into  a  temporal  relation 
ship  between  two  sub-concepts  (see  Prop.  25).    Each  of  these 
sub-concepts  does  not  seem  to  have  Independent  status  as 
properties  of  the  concept  "teeth."        contrast,  the  next 
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Table  3.1 
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sentence  differs  1n  that  "slanting  backward"  is  a  property 
of  teeth  (Prop.  26)  and  also  a  causeof  "holding  food 
securely  In  the  mouth"  (Prop.  27).    However,  this  last 
concept,  by  Itself,  Is  not  a  property  of  teeth  and  thus  a 
vertical  line  does  not  appear  liranedlately after  the  causal 
arrow..    The  vertical  1  Ine  just  before  "fearsome  , hunter"  - 
Indicates  that  a  relatlonsfhip  proposition  Is  needed  to  show  • 
the  direct  relationship  between  shark  and  fearsome  hunter 
(Prop.  31).  ^ 

Level  of  embeddedness.    Once  the  list  of  relationship  propositions 
Is  produced,  the  /evel  of  embeddedness  of  each  proposition  can  be 
determined.    Embeddedness  refers  to  the  number  of  t1e§  that  are  needed 
to  connect  any  concepj  to  the  main  topic  of  a  text.    Concepts  that 
are  further  from  the  main  concept  have  higher  embeddedness  numbers. 
For  example  In  Table  3^,  the  propositions  In  which  the  tq|(1c  of  the  ^ 
text  appears  as  Concept  A  (Props.  1-7)' all  have  levels  of  embedded- 
ness of  1.    Proposition  28  Is  the  most  embedded  Idea  and  requires  6 
steps  before  It  Is  connected  to  the  main  topic. 

The  construct  of  embeddedness  In  mapping  Is  related  to  the 
hierarchies  of  propositions  produced  using  Kintsch's  or  Meyer's  sys- 
tems of  anlysls  and,  like  theirs,  overlaps  (more  or  less)w1th  an 
Intuitive  or  rated  sense  of  the  Importance  of  concepts  In  a  passage. 

St 

On  a  study  fully  described  In  a  later  section  of  this  report,  we 
attempted  to, test  this  notion  directly.    We  asked  students  to  rate 
the  Impbrtance  of  sentences  corresponding  to  propositions.   We  then 
tested  whether  Information  more  closely  tied  to  the  main  topic  (low 
embeddedness  levels)  received  higher  Importance  ratings  than  Infor-  ^ 
matlon  further  from  the  main  topic  (or  highly  embedded).    Our  predlc- 
tlonwas  confirmed.    In  addition,  results  of  the  learning  study 
described  In  Part  III  of  this  chapter.  In  which  high  school  students 
recalled  passages  taken  from  their  textbooks.  Indicated  that  relation- 
ship propositions  that  were  highly  embedded  were  recalled  less  frequentl 
Thus,  our  formal  system  of  Indicating  hierarchy  of. concepts,  "embed- 
dedness, seems  to  be  related  to  the  Intuitive  concept  of  Importance 
In  text. 
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A  caution  is  needed,  however/   Level  of  embeddednesB  is  an  arti- 
fact of  the  structuredecJsions  made  dtrring  mapping,  and,  to  some 
degree,  pf  the  order  of  pre'^entation  of  concepts  within  the  text.  In 
soijne  cases,  seemingly  trivial  concepts  are  used  to  introduce  the  topic 
of  a  text,  sire  placed  at  the  beginning  of  a  passage,  and  so,  show  up 
a$  Level  One  relationship   propostions,  being  connected  only  to  the 
topic  concept.    For  this  reason,  levels  of  embeddedness  canno^  be 
equated  directly  with  an  intuitive  concept  of  "importance"  although 
a  high  degree  of  cotrrespondence  can  be  expected  , as  noted  abave. 

Rated  expl icitness.    As  described  earlier,  concepts  and  relation- 

>   '  ^ 

^shlps  occasionally  jpust  be  inferred  in  order  to  produce  a  coherent 
representation  of  the  text;    It  is  reasonable  to  expect  that  these  Items 
may  cause  difficulties  for  students  reading  the.  text.    To  test  notions 
of  wh'ether/^nd  where  authors  remain  iiiipl><r1t  in' presenting  information 
and  of  how  students  respond  to  such  processing  dematrds^,  we  need  a 
flietho(|  of  Indicatlng^in  our  relationship  list  which  parts  of  pro- 
positions were  Inferred  in  the  process  of  representing  the. text.  We 
have^found  that  a  Judgmenl^tall ,  usually  made  by  two  raters  working 
Independently  and  then  resolving  differences  in  conference,  works 
very  well  In  that  raters  typically  agree  with  each  other  on  most 
decisions;    The  procedure* Involves  taking  each  part  of  each  proposition 
(Concept  A,  Relationship,  Concept  B),  Comparing  it  to  the  original 
text,  and.  deciding  whether  the  author/has  given  an^xpliclt  indicator 
of  that  paVt  in  the  text.    In  ^able  3:  V  the  "O's"  above  the  words 
indicate  implicit  information  and  the  "Ts"  indicate  expl  icit  Infor- 
mation.   In  comparison  to  other  texts  we  have  analyzed,  the  sample 

V 

text  used  in  this  section  is  unusually  explicit  in  rendering  its 
structure.  ^  ' 

'  ^Je  have  found  that  expl icitness  decisions  are  fairly  easy  to 
make  for  the  concept^parts  ai^d  for  most;  of  the  relationships.  The 
one  difficulty  occurs  with  the  property  relationship.  Where  for  other  ^ 
relationships  we  adopted  a  fairly  strict  criterion  of  requiring  an 
expl icit  marker  of  the  relationships  we  rated  property  relationships 
as  explicit  whenever  the  connection  between  two  concepts  was  fairly 
obvious.    Compare  Proposition  15  to  Proposition   13,  14,  16  and  17. 
Verbs  of  possession  mark  the  connection  between ^the  two  concepts  In 
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Propositions  13,  14  and  16.    The  concepts  of  Proposition  17  are 
stm  relatively  explicitly  connected  by  being  presented  consecutively 
In  the  same  sentence.    Proposition  15  represents  the  property  relation- 
ship that  holds  "sharks"  with  "mouth."    We  judge  the  relatiorjship  to 
be  lmpllcit  because  the  concept  "mouth"  Is  given -without  introduction 
and  without  direct  mention  that  the  author ^s  talking  about  a  feature' 
of  sharks.    Still,  the  decision  Is  a  relatively  less  assured  one  as 
Indicated  by  the  fact  that  two  raters  working  independently  came  to 
different  decisions  and  then  voted  for  a  rating  of  Implicit  after 
discussion. 

Considering  a  relationship  proposition  as  a  single  idea,  varying 
types  or  degrees  of  expllcltness  are  possible,  ranging  from  a  totally 
explicit  relationship  proposition  (1-Kl)  to^  a  totally  Jmpl Icit 
relationship  proposition  (0-0-0).    By  ratlAg  each  part  of  the  relatlpn- 
shlp  proposition  Individually,  this  method  can  Identify  cases  where 
only  the  relationship  has  been  Inferred  from  the  iext  (1-0-1)  or  where, 
one  or  both  of  the  concepts  has  been  Inferred  (0-1-1,  1-1-0,  or  0-1-0). 
In  the  samples  we  analyzedjfrom  high  school  biology  and  history  text- 
books, the  most  commonly  impllclty  component  was  the  relationship 
between  concepts  (1-0-1). 
Problems  and  Promise      •      "  ,    -  ' 

For  any  given  concept  In  a  text,  mapping  analysis  Indicates  how 
It  relates  to  other  concepts,,  how  expl Icltly  the  text  states  the  con- 
cept and  Its  relationships,  and  how  embedded  the  concept  Is  within 
the  overall  text  structure.    There  are  two  major  pr*obl ems  with  the  s 
system  we  have  developed.    The  first  Is  that  Is  Is  very  much  dependent 
upon  the  subjective  judgment  of  the  text  analyst.    Subjectivity  comes 
In  at  the  .point  of  deciding  what  Is  a  concept,  what  Is  the  major  topic 
of  a  text,  what  are  the  main  structural  relationships  presented  by 
the  author  (what  Is  the  overall  shape  of  things),  and  what  Is  explicitly 
stated  In  the  text^,  for  example.    Granted  we  have  developed  certain 
guidelines  to  Increase  the  consensual Ity  of  analysis.    And  granted  we 
take  our  cue,  as  much  as  possible  from  what  the  author. Is  explicitly, 
saying  about  a  topic.  However,  the  process  Is  not  a  forfnal  system  In 
the  way  that  Kintsch's  micro-proposltlonal  analysis  approximates. 
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Relational  mapping  provides  a  picture  ofl^hat  the  text  analyst  under- 
stands  to  be  the  message  of  the  author,  and  at  best,  iThat  picture  w/1 11 
be  fairly  reliable  from  .one  expert  r6ader/analyst  to  xlTr-tiext.  '     ^  n 

The  second  major  problem  derives  from*  the  first  and  Is  related  . 
to  the  Issue  of -alternAte  maps  for  the  same^xt..  In  our;analys1s  of 
natural  ly  occurring  pieces  of  d1scoiNi:se,       frequently  found  that  two 
text  analysts  working  Independently  re^ic^Sented  the  same  text  In 
radically  different  forms.    Usually  when  this  occurred,  a  discussion  ^ 
session  would  result  In  some  sort  of  concensus  map  that  "felt  right" 
to  both  analysts.    However,  fairly  often,  we  were  struQk  by  how  ambig- 
uous authors  were  In,  say^^nd  lea  ting  that  they  wished  the  r^er  to 
constrast  two  concepts  rather  than  to  simply  descr'^ra  them.  In 
addition,    we  found  that  even  where  authors  seemed  to  be  following 
one^ distinct  type  of  relationship  pattern,  a  reader  (or  analyst  In 
this  case)  could  easily  produce  a  Wry  different  map,  reflefcting  a 
special  question  he  or  she  was  pursuing  In  reading  theftext. 

This  last  problem  may,-;'n  fact,  -turn  out  to  be  a  virtue  of  rela- 
tional mapping, reflecting  tts  flexlbll It/In  representing  text.  As 
•m^ny  have  claimed  (Pichert  &  And^rsften,  1977;  Harste,  1982),  a  text  Is 
not  ah  object  to 'be  described  apart  'from  a  comprehender.    What  makes  a 
text  a  text  Is  Its  coherent  representation  first  In  the  author's  and 
^<Jien  Irfthe  reader's  mind.    The  meaning  and  structure'of  a  text  irre  not 
Inherent  In  tne  text  but  are  Invited  by, the  author  and  Imputed  to  the 
text  by  the  reader..   Our  system  captures  this  view  of  text  and  assigns 
responsibility  to  the  text  analyst  to  decide,  what  structure  of  a  text,, 
best  reflects  the  purpose  It  Is  being  used  for..  For  Instructional 
purposes,  the  system  can  be  reponslve  to        teaching  objectives  and 
can  be  adopted  by  learners  to  help  them  use  their  textbooks  for  what- 
ever purpose  they  are  pursuing.  . 
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PART  2:  THE  NATURE  OF  TEXTBOOK  LANGUAGE 

In  this  section,  we  report  results  related  to  our  goal  to  describe 
and  analyze  the  nature  of  expository  text  by  sampling  textbook  passages 
and  subjecting  these  to  our  mapping  analysis.    Our  objepti  vei  was  to  , 
identify  systematic  patterns  in  the  ways  textbook  authors  present  their 
ideas.    In  contrast  to  much  of  tfie  existing  empirical  literature,  we  , 
focused  on  "natural"  pieces  of  discourse  anc!  attempted  to. examine' them 
as  much  as  possible  within  their  natural  ecological  setting.  . 

To  this  end,  our  general  procedure  was  to  -enlist  the  advice  of 
secondary  teachers  in 'identifying  segments  of  their  textbook  tH at  they 
considered  important  for  their  own  stjudents,  asking,  these  students  to  ■  , 
tell  us  how  difficult  they  perceiveid  the  samples  to  be  to  study,  then  \ 
analyzing  passages  identified  as  easy  and  as  difficult  in  terms  of  the  , 
concepts,  relationships,  and  stjuctural  characteristics  of  the  texts. 
■  :     '^Method -  ' . 

P^art^ci  pants        1*  . 

The  students^  and  teachers  who  participated  irr  this  part  of  the  stu(ly 
w^re  selected  from  those  who  responded  to  the^ survey  described  in  Section 
II."  In  Texas, one, teacher  of  three'sections  of  Biology  and  one  teacher, 
of  one  section  of  History  participated'.    In  Illinois,  three  Biology  and 
three  History  teachers  along  with  the  students  from  one- section  Tor  each 
teacJier  agreed  to  conti nue  i n  th^  study.    The  select i on  of  teachers 
and  their  students  was  based  pr-imarily  on  their  iheport  that,  ih  their 
classes,  the  textbook  used  was  an  essential  source  of  information. 
Selection  of  Materials 

the  teachers'  role.    Each  teacher  was  asked  to  identify  the  chapter 
or  unit  they  wGu^ld  be  addressing  a^  point  (two  months  hence) 

in  the  spring  semester.    Within  the; selected  chapters,  they  marked  off 
specific  sub-sections  that  they  would  NOT  be  assigning  as  required-  * 
reading  to  their  students.   Thus,  the  teachers  eliminated  content  they 
did  not  plan  to  emphasize,  leaving  us  with  those  sections  of  text  for 
which  students  would  be  held  responsible,  i.e.,  text  integral  to  their 

curriculum.  ,  ^ 

Our  (researchers)  role.  At  this  point,  we  needed  to  segment  the 
relevant  sections  of  chapters  in  order  to  test  the  reliability  of  our 
description  of  text.and  to  have  manageable  amounts  of  material  to  be 


presented  to  students  in  a  subsequent  learning  task  (see  Part  III  of 
this  section).    After  reading  the  sections  of 'each  textbook  chapter  * 
remaining  subsequent  to  the  teachers'  elimination  procedure,  we  decided 
that  ia  natural  unit  size  vftthin  these  sections  consisted  of  approximately 
300  words.    Many  times  the  boundaries  of  a  unit  coincided  with  t>iose 
demarcated  by  bold-face  headings.    We  also  decided  that  we  would  have 
a  more  powerful  test  pf  critical  text  characteristics  that  lead  to 
difficulties  in  learning,  if  we  took  some  measure  to  assure  that  our 
sample  of  texts  represented  a  continuum  of  difficulty. 

Across  the  teacheri  participating  in  Texas  and  in  Illinois,  three 
Biology  and  threfe  History  textbooks  were  represented.    For  each  text- 
book, we  selected  eight  samples  of  250  to. 300  words  long  from  the  sections 
deemed  relevant  by  the  teachers.    We  then  prepared  booklets  consisting  of 
the  eight  texts,  each  followed  by  a  rating  scale  asking  students  to  sjiecify 
.    ,         how  difficult;  they  judged  it  would  be  to  stijdy  that  text  Jf  it  were.gi  ven 
as  a  reading  assignment,  (see  Table  3.2).    The  last  page  of  the  booklet 
asked  the  students  to  take  the  eight  passages  in  their  booklet  and  to 
rank  them  in  order  of  difficulty. 

The  students '  role.    At  a  point  approximately  two  weeks  away  from-  ^ 
when  the  target  chapter  was  to  be  discussed  in  class,  we  introduced  the 
rating/ranking  task  to  the -student^.   The  procedur*e  generally  took  from 
40  to  50  minutes  to  complete.   The  students  were  told, that,  since  the 
selections  ha'd  been  lifted  from  their  textbooks,  they  could*  refer  to  . 
their  textbooks  at  any  time  they  felt  the  need  to  reestablish  the  context 
of  each  passage.    (No  student  was  ever  observed  exercising  this  dptioh.) 

Results.    From  the  students'  responses,  we  chose  16  Biology  and  14 
Histdry  passages,  half  of  each  discipline  having  been  judged  difficult 
and  half,  easy  to  learn  from.   These  30  texts  comprised  the  basic  se^ 
used  in  subsequent  text  descr^iption  and  learning  experiments.  *The^ 
^        texts  together  with  their  maps  and  list  of  relationship  propositions 
appear  in  Appendix  D.  , 
Text  Analysis  Procedure  ' 

The  details  of  the  system  we  ^velpped  and  of  how  that  system  guides 
'  decisions  of  text  analysis  have  been  described  in  Part  I  of  this  section. 

In  applying  the  system  to  our  s?imple  of  texts,  graduate  research  assistants 
were  trained  and  then  assigned  in  p^lrs  to  work  on  producing  (Si  map  of 

.         :  ^      :-7o^-y:  /  . 
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Table's.?  '  ' 

OpihionTatljigs  |b  11  cited  from  high  school  students  to  determine 
^their^erception  of  the  difficulty  of  texts 

Keepifig  in  mi  rid  how  v/ou  typically  use  your  textbook  (for 
example  -  study  for  tests,  answer  the  questions  at  the      "  '  ■ 
end  of  the  chapter),  complete  the  following:  ' 

.    In  general ,  how  easy  was  it  for  you  to  understand  the  section? 

.        1  ■  .2  ■  .  ■  ,  •  -  '  3    /       •  4,  .^.  5^  ■  . 

very     .     easy     ^    medium       hard  r  very 
■  \.  easy  .      v'"  '  ^  ^  hard 


.    Retgardless  of  your  answer  to  question -I  ,  tel  l  us  to  what  extent 
each  of  the  following  was  a  problem  in  ffte  section. 

.  i.  *  not  a  \     '  an' 

problem    a  slight    a'    ^  important 

.    ,       at  all      problem-     problem  problem 

>v.      -     I    V      -  ,  ■      3       ,      .  4  ■ 

1.  The  sedtion  .}iad  many  hard 
words  which  make  it 
difficult  to  understand. 


« 

2.  The  section  is  pobrly,  " 
organized,  that  is,  it  ; 
is  written  in  a  way  that 
is  Wficult  to. follow. 


3.  the  section  was  difficult 
to  understand  because  you 
were  expected  to  have  more 
background  information 
than  you  had.  \J 


^.  .         .  .  * 
4.  The  section  was  difficult 
to  understand  because  it 
did  not  have  enough 
examj)les  or  clarification 
of  key  ideas.  J  , — —1 — l 
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each  text  In  bur  sample.   They  worked  Independently  and  then  met  to 
decide  on  the  map  that  seemed  to  capture  "best"  the  Intent  of  the^ text 
author.       ^  • 

Since  mapping  tends  to  encourage  text  analysts  to  focus  oh  concepts 
while  learners  must  deal  with  the  actual  surface  representation  of  the 
concepts,  we  were  concerned  that  our  maps  might  deviate  too  far' from 
the  actual  text  language  and  might  therefore  cause  special  problems 
when  it  came  time  to  score  free  recall  protocols  in  the  learning  study. 
(Note  that  this  potential  deviation  from  surface  representation  would 
not  be  a  problem  in  non-experimental  settings.) 

To  check  this  potential  deviation,  we  assigned  two  research  assis- 
tants'thejob  of  deriving  propositions  in  the  Kintsch  (1974);  Meyer  (1975) 
and  Frederiksen  (1975)  sens>iffrbm  the  texts.    The  maps  were  then  compared 
to  these  lists  of  propositions  and  adjusted  where  necessary  to  represent 
explicitly  any  content,  and  in  particular,  any  relation,  that  appeared 
in  the  proposition  list. 

The  list  of  relationship  propositions  was  then  derived  and  each 
proposition  was  assigned  an  embeddedness  number  and  rated  for  explicit- 
ness.   All  steps  were  performed  by  two  analysts  and  differences  of 
opinion  resolved  in  conference. 

Note  that  for  the  analyses  reported  in  this  and  the  next  sections, 
the  embeddedness  rating  was  determined  in  a  slightly  different  way  than 
described  in  Part  1  of  this  chapter.    We. were  faced  with  practical 
restrictions  stemming  from  our  computer  program  facilities  to  limit  the 
number  of  possible  levels  of  embeddedness  .to  eight.    Rather  than  simply 
counting 'the  number  of  ties  of  every  concept  to  , the  main  topic  of  the 
text,  a  procedure  that  would  frequently  have  exceeded  our  limit,  the  maps 
were  divided  into  major  sub-sections,,  corresponding  to  main  point^S^iith- 
in  a  text,    the  following  rules  served  as  guidelines  in  id^tifying 
main  sub-topi cS: 

1.  Any  property  subordinate  to  the  topic  concept  and  that  has 
two  or  more  subordinate  concepts  is  a  main  sub-topic.  (The 
number  of  subordinate  concepts  fol^  the  cutoff  is  somewhat 
arbitrary.) 

2.  Superordinite  concepts  in  any  large  process  box  or  example  box 
may  become  main  sub-topics. 
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3.    Paragraph  structure  of  the  text  may  be  used  to  validate  selection 
of  a  main  suh-topic  when  the  preceding  rules  offer  insufficient 
guidance. 

The  first  step  in  determining  levels  of  erabeddedness,  then,  was  to 
designate  main  sub-topics  on  the  map  by  assigning  them  unique  one-digit 
numbers.    These  numbers  served  as  the  first  digits  of  a  string  of  digits 
describing  how  subordinate  concepts  were  related  to  the  main  concept, 
there  are  nine  numbers  that  can  then  appear  after  the  decimal,  ejich 
number  uniquely  representing  each  of  the  nine  relationshi^p  types  allowed 
by  the  system.    By  this  system,  embeddedness  numbers  are  not  unique  to 
each  relationship  proposition.    For  example,  two  examples  of  a  main 
'  concept  at  the  same  level  of  embeddedness  would  have  exactly  the  same 
digit  string.    The  final  digit  in  each  string  describes  how  Concept  B 
of  the  given  relationship  proposition  is  related  to  its  Concept  A. 

The  actual  level  of  embeddedness  is  measured  by  counting  the  number 
of  digits  beyond  the  initial  main  concept  digit;  that  is,  behind  the 
decimal  point.    In  most  of  the  analyses  we  conducted,  we  used  the  embed- 
dedness level  to  form  twd  tiategories,  "high"  ideas  being  identified  by 
relationship  propositions  one  or  two  steps  away  from  the  main  sub-topics 
and  "low"  ideas  identifieij  as  propositions  three  or  more  steps  from  the 
main  sub-topics. 

Results 

In  this  sections,  we  present  the  descriptive  tables  of  our  30 
sample  texts  in  terms  of  the  products  that  fall  out  of  a  relational 
mapping  analysis.    Thus  we  report  text  characteristics  related  to  types 
of  relationships,  levels  of  embeddedness  and  degree  of  expl icitness. 
In  this  and  all  subsequent  analyses  of  text  characteristics",  we  have  kept 
the  biology  and  history  texts  separate. 

In  the  summary  tables  that  follow,  the  total  number  of  propositions 
and  parts  of  propositions  is  listed  identified  by  the  two  variables  on 
the  cell  margins.    We  report  our  analyses  of  the  16  Biology  samples  and 
14  History  texts  separately.    Each  set  of  texts  is  described  using  three 
different  breakdowns  of  the  variables  that  derive  from  relational  mapping: 
1)  level  of  embeddedness  (high  =  1  or  2  steps  from  a  main  topic,  low  = 
more  than  2  steps)  by  expl icitness  (explicit  =  all  parts  are  explicit. 
Implicit  =  any  one  of  the  three  parts  of  the  proposition  is  implicit); 
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2)  level  of  embeddedness  by  relationship  type  (the  nine  relationship 
types  of  the  system  were  reduced  to  six  by  combining  a11  the  comparative 
relationships  "greater  than,"  "less  than,"  "similar,"  "Is  not  similar," 
into  one  category);  3)  relationship  type  by  expllcltness.    For  each  of 
these  breakdowns,  )ne  report  the  numbers  relevant  to  describing  1)  the 
whole  proposition  CALLS),  2)  the  two  concepts  In  the  propositions 
(Concept  A  and  Concept  B),  and  3)  the  relationship  part.    Note  that 
the  numbers  jippearing  the  the  total  columns  for  the  concept  parts  will 
be  twice  as  l-arge  as  those  for  the  whole  proposition  (ALLS)  since  every 
proposition  Includes  two  concepts. 

As  Indicated  In  Table  3.3  propositions  of  the  biology  texts  were  evenly 
divided  between  those  closely  tied  to  the  main  topic  and  those  further 
away.    There  were  nearly  twice  as  many  propositions  that  had  all  three 
parts  (Concepts  A' and  B  and  the  relationship)  explicitly   rendered  In 
the  text  as  propositions  that  had  at  Teast  one  Implicit  part.  However, 
It  Is  Interesting  to  note  that  35%  of  the  high  level  propositions  fell 
in  the  Implicit  category.    Of  the  high  level  propositions  29%  were  rated 
implicit  because  the  relationship  part, of  the  proposition  was  not  expll- 
cit.     This  suggest?  that  our  textbook  authors  frequently  were  not 
explicit  in  how  two  high  level  concepts  were  related. 

The. pattern  for  history  texts  was  very  similar,  as  shown  in  Table 
3.4  except  that  the  relative  proportion  of  propositions  closely  tied 
to  the  main  topic  was  substantially  larger.    Again,  the  proportion  of 
high  level  propositions  that  were  rated  implicit  was  quite  high,  making 
up  48%  of  the  units,  close  to  the  main  topic.    Implicit  relationship  parts 
appeared  iH  41%  of  the  high  level  propositions. 

What  is  noteworthy  in  Table  3.5  is  that  the  majority  of  the  relation- 
ships in  our  biology  texts  were  properties  (57%).    If  we  combine  pro- 
perties with  examples,  we  account  for  76%  of  the  relationships.  Process 
relationships  (temporal"  and  causal)  make  up*only  12%  of  the  total. 
History  texts  show  much  the  same  pattern  (see  Table  3.6).    A^ain,  pro- 
perties and  examples  make  up  76%  of  the  total  number  of  propositions, 
with  process  relationships  taking  up  only  15%. 

In  Tables  3.7  and  3.8,  frequencies  are  reported  for  propositions 
representing  explicit  and  implicit  renderings  of  the  different  relation- 
ship types.    For  biology  texts  most  relationship  types  are  much  more 


Table  3.3 

Biology:    Number  of  propostttons  and  parts  of  propositions  identified 
by  level  of  erabeddedness  arid  explicitness 

1.    ALLS  (the  whole  propositions) 


Explicitness 


Level. 

Implicit 

Explicit' 

'total 

High 

155 

283 

438  - 

Low 

119 

310 

429 

Total 

274 

593 

- 

• 

2.    Conceots  A  &  B 

• 

Level 

Implicit 

Explicit 

Total 

High 

71 

805 

876 

Low 

45 

813 

858 

Total 

116  ^ 

1618 

3.  J^elationshiDS 

Level'  ^ 

Implicit 

Explicit 

Total 

High 

127 

311 

43d 

Low 

107 

332 

429 

"8- 

Total 

234 

633 

75 
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Table  3.4 


History:    Number  of  propositions  and^part^  of  propositions  identified 
by  level  Of  embeddedness  and  explicltness 


1.  ALLS 

Explicltness 

■ 

Level 

Implicit 

jt 

Explicit 

Total 

.     High  . 

169 

182 

351 

Low 

-  63 

165 

228 

Total  ' 

> 

232 

347 

579  • 

2.    Concepts  A  &  B 

Level 

r 

Implicit 

Explicit 

Total 

High 

59 

643 

702 

Low 

4 

452  • 

456 

Total 

63 

1095 

V 

3.  Relationships 

Level 

Implicit 

Explicit 

Total 

High 

145 

206 

351 

Low 

62 

166 

228 

,  Total 

207 

372 

76 
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Table  3.5 

Biology:    Number  of  propositions  and  parts  of  propositiqns  identified 
by  level  of  erobeddedness  and  relationship  type 

1.  ALLS 

Level 


Type 

High 

Low 

Total 

Definition 

8 

12 

20 

.  Property 

272 

'  220_ 

.  492 

Example 

98 

'    73  - 

171 

^omparison 

27 

49 

76 

Temporal 

11 

44 

55 

Causal 

22 

31 

53 

Total 

438 

429 

867 

2.    Concepts  A  &  B 

In  this  case,  this  breakdown  is  redundant  with'  the  above 
numbers.    Simply  take  the  frequencies  listed  above  and  double 
them.  ^ 


3.  Relationships 

Exactly  redundant  with  the  above  numbers. 


< 
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Table  3.6 

t 

History:    Number  of  propositions  and  parts  of  propositions  identified 
by  level  of  embeddedness  and  relationship  type 

1.  ALLS 


Type 

High 

Level 
Low 

Total 

Definition 

3 

5 

8 

Property 

171 

113 

284 

Example 

109 

47 

,  156 

Comparison 

'"31 

.  13 

44 

Temporal 

17 

21  . 

38 

-  Causal 

20  . 

29 

49 

Total  351  228  579 


Z.    Concepts  A  &  B 

Frequencies  are  redundant  with  the  above  except  that  e^Tch 
number  needs  to  be  doubled. 


3.  Relationships 

Exactly  reijundant  with  frequencies  for  whole  propositions. 
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Table  3.7 


Biology:    Number  of  propositions,  and  parts  of  propositions  Identified 
.by  exul Id tness  and  relationship  type 


1.'  ALLS 

■Si 

2.  Concepts  A  &  B 

3.  Relationship 

Explicitness 
Tvoe                 Imp.  <  Exp.  . 

Explicitness 
Imp.  Exp. 

ExpllcltniBss 
Imp.  Exp. 

Definition 

4 

16 

-  2 

38  , 

,  •       5  % 

Property 

90 

"402 

55' 

929  ' 

61  .431 

.  Example 

108 

63 

37 

305 

103  67 

Comparison 

23 

53 

11 

141 

18  58 

Temporal 

36 

7 

103 

36  19 

Causal 

13 

40 

4, 

102' 

-      U  .42 

Total 

274 

593 

116 

1618 

234  633 

*  ^  DP 
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Table  3.8 


History:-  Number  of  propositions  and  parts  of  propositibns  identified 
by  expHcltness  and  relationship  type 


1.  ALLS 

2.  Concepts  A  &  B 

3*  Rel alilon^hl n 

Type 

Explicitness 
Imp.  ExD. 

Explicitness 
Imp.  Exb. 

• 

ExdI 1 c1 tnes^ 
Imp.  ExD. 

Definition 

2 

6 

0 

•  16  - 

2  6 

Property 

66 

218 

35 

533 

. 46  238 

Example 

108 

48 

20- 

105  51 

Comparison- 

11 

33 

9  35 

Temporal 

22 

16 

'  >  76 

•    22  16 

Causal 

'  23 

26 

5 

93 

23  26 

Total 

232  , 

347 

63 

\ 

1095 

207  .372 

*  / 

-  / 
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often  stated  explicitly  by  the  authors  than  implicitly.   The  two 
notable  exceptions  are  example  and  temporal  relationships,  f^r  which 
Implicit  propositions  are  nearly  twice  as  frequent  as  explicit 
propositions.    For  these,  nearly  all  Implicit  ratings  come  from  having 
,the' relationship  part  rendered  implicitly.    History  texts  show  the 
same  pattern.  -Example  relationships  are  particularly  likely  to  remain 
Iraprlicit  in  history  texts,  occurring  twice  as  often  as  explicit  example 
propositions  and  making  up  nearly  half  of  all  implicit  relationships 
In  the  texts. 

»  Discussion 

the  results  described  above  represent  a  sumnary  of  text  features 
that  are  emphasized  by  our  relational  mapping  procedure.    From  these 
we  can  say  that  the  authors  of  the  History  Ind  Biology  textbooks  we 
sampled  were  frequently  implicit  about  how  icfeas  they  were  relating 
were  logically  connected  to  each  other.  ■  High  level  ideas,  or  ideas 
that  are  close  to  the  main  topic  of  a  text,  were  more  likely  to  remain 
implicitly  tied  to  lower  ideas  in  a  text  than  to  be' directly  explicated. 
In  addition,  we  found  that  our  authors  relied  on (Properties  and  examples 
as  the  major  way. of  developing  topics.    Neverthel^,    24^  of  their  ideas 
pertained  to,  the. distinctive  relationships. (definition,  comparison, 
temporal,  and  causal)  that  relational  mapping  depicts  sa,welT. 

"    At  this  point,  what  remained  to  be  established  was  the  relative 
contribution  of  these  text  features  to  students'  facility  with  learning 
from  the  texts,   this" issue  is  taken  up  in  the  next  part.  . 
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PART  3:  '  THE  LEARNABILITY  OF  TEXTBOOK  LANGUAGE 

The  purpose  of  this  aspect  of  our  project  was  to  determine  how 
well  high  school  studertts  would  learn  from  their  textbooks.   We  hoped 
to  use  their  performance  on  recall  an^^ recognition  measures  to  identify 
those  features,  out  of  the  many  possible  that  can  be  derived  from  rela- 
tional mapping*  that  coincided  with  learning  difficulties.    Our  general 
procedure  was  distinguished  by  having  students  tested  on  information 
from  their  own  textbooks  in  t^heir  own  classrooms  at  the  point  in  the 
school  semester  when  the  target  segments  of  the  textbooks  were  aj)0ut  to 
be  discussed  in  class.    Thus  naturalistic  contUtions  for  learning  in 
the  content  ar»as  were  approached. 

•  Method. 

Subjects 

The  same  students  who  had  ratkd^passages  taken  from  their  textbooks 
participated.    To  repeat,  werhad  three  sections  of  10th  grade  level 
Biology  (60  students)  and  on^  section  of  10th  grade  American  History 
(17  Ss)Mn  Austin.    In  Illinois,  three  Biology  and  three  History 
classes  participated  (range  of  n  =  14  to  18). 
Procedure  and  Materials 

Across  all  participants,  the  texts  were  the  30  selected,  analyzed 

and  described  in  Part  2.    For  each,  student,  only  two  passages  were 

presented  as  part  of  the  learning  study.    For  each  of  these  two  texts, 

as  well  as  for  a  practice  text  selected  from  the  same  textbook,  the 

students  followed  an  eight-step  procedure: 

i     Step  1.    Predict  on  a  scale  from  1  to  4  how  well  you  will  Mnder- 
.    '      stand  the  following  selection  whioh  has  been  taken  from 
\  your  textbook.  ,  i 

Step  2.    R^ad  and  learn  the  text  as  best  as  you  can  for  as  long 
as  it  takes  you  to  be  ready  for  a  test.  «> 

Step  3.    Rate  how  well  you  understood  the  selection  you  just  read. 

Step  4.    Write  down  as  thoroughly  as  you  can  everything  you  can 
remember  from, the  selection  without  referring  back  to  ^ 
the  passage  (-free  recall). 

Step  5.    Answer  the  following  short-answer  questions  as  bgstcari. 

(Approximately. six  short  answer  questions  followed  ea,ch  , 
passage.    At  least  two  adult  readers  formylated  a  set  of 
questions  for  each  passage,  and  thbse  questions  which 
recurred  across  ^ets  were  selected  for  use  in  tjie 
experiment.)  y 


step  6.  ,  Rate  eaci)  question  in  terms  Of  how  sirailar"1t  is  to  one 
vydur teacher  would' ask.    (The  scale  ran  from  1  to  5.) 

Step  7.    Given  a  list  of  eigKt  statements,  choose*  €tlree  that  best 
represeQt.the  jnain  ideas  in  the  section.  •  CAgain,  a  set 
of  statements  were  g6nerated  by  at  least  two  adult 
readers,  and  those  statements  which  recurred  across  sets 
Were  ■selected*   Threee  , statements  perceived  to  be  super- 
•   ordinate  or  main  Ideas  and  five  stateipentS  perceived  to 
be  subbrdihate  or  details  were  included  in  each  set  of 
r  eight.) 

Setp  8.    Now  that  you  have  been  tested  on  what  you  know  about  tfi^e 
;    previous  Sjelectlon,  rate  how  well  you  think  you  under-  a 
-  -stood  it. 

The  students  received  their  packets  iiJ*%in  envelope.   They  were 
instructed  to  go  through  the  steps  involved  with  the  practice  passage 
although  they  did  not  have  to  actually  produde  responses  to  the  measures 
"They-  then  proceded  at  their  own  pace  through  the  two  critical  text 
samples  and  their  associated  measures.    Total  time  allowed  for  the  whole 
procedure  was  the  equivalent  of  one  class  period  and  most  students  had 
finished  after  45  minuses. 

In  this  section  of  the  report,  we  will  discuss  results  stemming 
solely  fro^  the  students'  responses'to  the  free  recall  task,  Other 
measures  arte  discussed  as  part  of  the  section  on  reader  characteristics 
(Section  V>.  ' 
Scori  ng  , ' 

All.  free  recall  protocols  produced  in  response  to  one  text  were 
grouped  togetherl  Jwo  graduate  research  assistants  wfere  assigned  to 
each  text.    They  were  instructed  to -begin  by  independently  scoring  two 
or  so  fairly  long  protocols.    They* then  met  to  discuss  the  rati'onale 
for  each  of  their  scoring  decisions.    They  then  identified  randomly 
three  or  .four  protocols  that  they  would  both  score  independently  and 
that  would  become  the  basis  of  a  reliability  estimate  for  free  recall  . 
scoring. •  The  rest  of  the  protocols  associated  with  any   one  text 
were  then  divided  eVenly  between  the  two  scorers  and  al  so  scored,  inide- 
pendently.    This  procedure  was  followed  for  all  3D  texts,  with  six^ 
research  assistants  associated  with  the  project  being  paired  and  re-  " 
paired  in  al  1  possible  combinations.- We  hoped  that  this  procedure  would 
mitigate  against  any  bias  creeping  into  the  scoring  of  the  protocols.  _ 
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The  scoring  procedure  that  each  research  assistant  followed  in-  , 

olved  six  basic  steps:  -  :  ^ 

Step  1.    Read  original  text,  absorb  map,  read  through  the.  list  of 
relationships. 

Step  2.    Read  through  student's,  protocol . 

•  Step  3.    Read  the  first  phrase  or  sentence  and  locate  where  in  the 
list  of  r^aticjiships  it  seems  to  be  talking  about. 

Step  4.  •  Decide  on  the  first  relationship  to  be  scored*  Each 

relationshipl^fs  the  potential  of  being  scored  4  times: 
once  for  each  of  the  parts  and  then  once  again  as  a  whole. 
We  number  these  as  follows: 

If  it  is  Relationship  #10  we  feeV  is  being  mentioned  by  S^^, 
we  score 

10.1  =  is  Concept  I  (A)  of  the  relationship  there  at  all? 

10.2  =  is  the  relationship  there? 

10.3  -  is  Concept  II  (B)  there? 

10.0  ^  is  this^whole  relationship  proposition  present? 

Step  5.    Now  we  decide'if  each  of  these  (10.1,  10.2,  and  so  on)  Is 
to  be  scored 

A  =  correct  and  explicitly  stated.    Accept  a  close 
:  paraphrase. 

B  =  correct  and  implicitly  stated  (by  the  studerit,  not  * 
tre  text).    Often  a  B  is  given  when  student  provi ded 
'  ayfcore  general  descriptor  of  a  concept  or  provi d%^ 

ar  superordinate  or  subordinate  type  term:  that  implies 
,the  explicit  statement  of  the  concept  or  relation. 

C  =  explicit  (and  some  implicit  responses  that  are  very 
obvious)  and  wrong.,  . 

|/  >  give  this  score  to  a  statement  on  part  of  student  that 
you  cannot  relate  to  any  relationship  proposition  but 
that  is  correct  and  about^ the  topic  of  the  text  in  a 
general  way. 

All  statemerits  by  the  student  should  be  accounted  for  by  the  time  , 
you  finish., 

*  Step  6.    Apply  some  conventions  we'v^decided  on: 

^     1.    If  any  part  of  a  relationship  proposition  gets  a  C, 

\    the  whole  (e.g.,  10.0)  gets  a     (if  all  parts  are  present) 

2..  If  any  part  of  a  relationship  proposition  gets  a  B, 
the  whole  thing  gets  a  B  (if  all  parts  are  present). 

8..    If  a  technical  term  is  not  mentioned  but  a  general  and 
^.     correct  descriptor  is  substituted,  the  person  would  get 
a  B.    If  the  actual  technical  term  is  used  correctly 
latef  on,  re-score  the  first  Relationship  Voposition 
that  uses  that  term  and  give  it  an  A.    (Don't  worry 
too  much  about  thi  s  conventi,afFr) 


4.   Whenever  a  part  or  a  whole  proposition  gets  scored 
r  /  twice,  the  record  should  only  show  the  highest  . 

'  VA>B>C)  score  and  only  once. 

In  Appendix  E,  examples  of  ^  protocols  produced  in  response  to 

xt  #116,  "Protozoa,"  appear.^   Scoring  and  the  rationale  of  each   \ , 

sAring  decision  is  given.  / 

Data  Analysis 

In  our  first  look  at  the  data  genesrated  from  the  fwee  recall 
protocols,  we  were  interested  in  identifying  the  contribution  of  parti- 
cular text  features  to  students'  ability  to  recall  the  excerpts  from 
their  textbooks. ,  Thus  we  chose  relationship  propositions  as  the  repli-  • 
cation  factor  and  created  scores  for  each  relationship  proposition  that 
reflected  the  proportion  of  studentjs  assigned  to  learn  the  text  who  had 
actually   recalled  that  relationship  proposition.    The  "n"  in  the  analyses 
reported  below  becomes  the  number^qf  propositions  Identified  by  the  factor 
^of  the  designs  and  can  be  found  by  referring  to  the  appropriate-tables  ^ 
in  Part  il  (see  Tables  3.3  to  3.8): 

Results 

Sunward  of  Analyses  ,        ^  • 

The  proportions  generated  for  each  relationship  proposition  were 
normalized  using  arcsin  transformatiotis.    They  were  then  subjected  to 
a  series  of  two-way  analyses  of  variance.    Biology  and  History  texts 
were  analyzed  separately;.    In  the  following  tables,  the  numbers  refer 
to  the  mean 'proportion  score  (re-converted  from  the  arcsin  transformation 
score)  received  by  unij;s  of  the  type  specified  by  factors  identified  in 
the  table  margins-.    In  other  words,  the  entries  in  the  tables  represent 
the  average  proportion  6f  students  who  recaVled  units  of  the  identified 
type. 

The  same  three  major  breakdowns  of  text  characteristics  that  were 
used  to  describe  the* texts  were  used  to  analyze  the  recall  data:  i) 
level  of  embeddedness  (high  =  1  or  2  steps  from  a  main  topic,  low  = 
more'than  2  steps)  by  explicitness  (explicit  =  all  parts  are  explicit. 
Implicit  =  any  one  of  the  threp  parts  of  the  proposition  is  implicit); 
2)  level  of  embeddedness  by  relationship  type  (the  nine  relationship 
typeSs^f  the  system  were  reduced  to' six  by  combining.all  the  comparative 
relationships  "greater  than,"  "less  than,;'  "similar,"  "is  not  similar," 
into  one  category);  3)  relationship  type  by  explicitness. 


For  each  of  these  corahl nations  of  factors,  we  looked  at  the  propor- 
tion scores  for  the  whole  proposition  (identified  as  the  .0  scores  in  the 
scoring  system)  ,  for  the  concept  parts  combined  (identified  as  the  ^1 
and.  .3  scores  in  the  scoring  system),  and  for  the  relationship  part 
alone  (the  .2  scores  of  the  relationship  propositions).    All  of  the 
above  analyses  were  performed  using  only  units  that  had  received  an 
"A"  score  CexpTicit  recall)  and  then' in  separate  analyses,  units  that  had 
received,  a  "B"  score  (impli eft  recall).    For  the  whole  proposition  scores 
we  also  ran^  analyses  in  wh-fch  the  proportion  scores  were  computeg  with 
any^  proposition  receiving  an  "A"  OR  a  "B"  being  tallied.  r 
Embeddedness  by  Ejcpl  i ci tness  ^  . 

.  In  Tables  3.9  and  3.10,  we  present  the  Biology  and  History  mean 
proportion  scores  Of  the  whole  propositions  identified  by  lev^l  of 
embeddedness  and  explici tness.     The. main  effects  were  nearly  always  ^ 
significant  as  was  the  interaction  for  the  History  texts.    Thus  we  can  • 
say  that  students  are  more  likely  to  recall  ideas    closely  tied  to  the 
main  topic  of  the  texts  (high  in  the  text  structure,  low  in  embec^ded- 
ness).    Ideas  that  the  authors  state  explicitly  are  more  likely  to  be 
mentioned  both  explicitly  and  when  exp,licit  and  implicit  recall  scores 
are  totaled.   The  bottom  thiir\J,of  each  of  the  tables  is  particularly 
interesting  in  that  the  special  disadvantage  that  ideas  high  in  a 
^text's  structure  have  if  authors  are  in  any  way  implicit  ici  presenting 
them  is  revealed  even  when  implicit  recall  is  credited. 

These  sunmary  descriptions  are  corroborated  when  individual  parts 
of  propositions,  either  the  two  concepts  or'Hhe relationships,  are  ana- 
lyzed (see-Tablesl  to  5  in  Appendix  F). 
Embeddedness  by  Relationship  Type  ' 

The  mean  proportion  scores  for  whole  propositions  identified  by 
level  of  embeddedness  §nd  relationship  type  appear  in  Tables  3.11  and 
3.12.   The  same  proportions  for  the  concept  parts  combined  and  the 
relationship  parts  appear  in  Tables  5  to  8  in  Appendix  F."   Again  the 
two  main  effects  are  nearly  always"  significant.    Definition  propositions 
seem  to  be  favored  by  students  learning  Biology  texts,  followed  by  pro- 
perty propositions.    When  the  combined  A  and  B  recall  scores  are  used, 
temporal  and  causal  propositions"  show  a  definite  improvement  in  their 


Table  3.9 


Biology:    Mean  proportion  scores  for  whole  (ALLS)  relationship  propositions  identified 
by  level  and  explicitness 


1.   A  scorfes  (units  Judaed  to  be 
explicitly  recalled) 

'  Explicitness**' 


Level  * 

Imp 

Exp 

Total  ! 

Imp 

Exp 

Total 

High 

.081 

.166 

.136 

.128 

.085 

.100  ^ 

Low 

.071 

.114 

.102 

.098 

.067 

.076 

Total 

.077 

.139 

.115 

.076 

*F  (1.863) 
**F  (1,863) 

=  9.94,  P  =  • 
=24.47,  p  = 

002 
.001 

*F  (1  ,863)  = 

•  **F  (1,863?  = 

p.  = 

=  6.1, 
=  .014 
=  15.67, 
=  .001 

Level  X  Exp: 

F  (1,863)  = 
p  = 

•2.56, 
.110 

Level 

X  Exp: 
.476,  p 

F  (1  ,863) 
=  .491 

B  scores  (units  judged  to 
be  Implicitly  or  partially 
recalled) 

Explicitness** 


A  +  B  scores  , totaled 

Exp]1c1tness**v  ; 

Imp     Exp  Total 

.209     .251  .236 

.169     .181  .178 

.192     .215  , 

*F  (1,863)  =  15.01, 
p  =  .001  - 
**F  (1,863)  =  2.84,  . 
p  =  .092 

Level  X  €xp:    F  (1  ,863)= 
.767,  p  =  .381 
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table  3.10 

History:   Mean  Proportion  scores  for  whole  (ALLS)  relationship  propositions  identified 
by  level  and  explicitness  f 


1.  .A  scores  (units  judqed  tp  be 
explicitly  recalled) 

Explicitriess** 

2.    B  scores  (units  judged  to 
be  implicitly  or  partially 
recalled) 

Explicitness** 

3.    A  +  B  scores  totaled 
Expltcitness** 

Level*      Imp     Exp  Total 

Imp      Exp  Total 

Imp      Exp  f\  Total  n 

High         .067    .145  .107 

.115      .101  .108 

.182     .245  .215 

Low           .070    .100  .092 

.140     .074  .092 

.210     .174  .184 

Total        .068  .124 

^  '    .122  .088 

.190     .212  .203 

*F  (1,575)  =  5.63,  p  =  .018 
**F  (1,575)  =  27.91  ,  p  =  .053 

(1  ,575)  =  .65, 

**F  (1  ,575)  =  8.93, 
p  =  .003 

*F  (1,575)  =  5.43, 

p  =  .02 
**F  (1,575)  =  3.52, 
p  =  .06 

Level  X  Exp:    F  (1,575)  =  3.75,  ^ 

p  =  .053  . 

Level  X  Exp:    F( 1,575)  = 
5.15,  p  =  .024 

Level  X  Exp:    F( 1,575) 
*  9.10,  p  =  .00,3 

.  88  ; 

a 

Table  3.11 


Biology:    Mean  proportion  scores  for  whole  (ALLS)  relationship  propositions  indentified 
by  embeddedness  and  relationship  type.  / 


1.  A 

scores 

(explicit  recall ) 

2.    B  score 

(implicit/partial 
,  recall) 

3.    A  + 

B  scores 

Level 

* 

Level* 

Level*  '-' 

Type** 

High 

Low 

Total 

High 

Low  Total 

High 

Low  Total 

Def 

.370 

z 

.204 

.129 

.075  .097 

.499 

.16¥  .301 

Prop 

.167 

.114 

.151 

.086 

.^58  .074 

.251 

.I9I  .225 

Examp 

.073 

.034 

.056 

.133 

.124  .129 

.207 

.15  8  \.186 

Comp 

.108 

^  .034 

.061 

.055 

.056  .056 

'  .163 

.091  .117 

Temp 

.027 

.Ut 

.118 

,166 

.087  .103 

.193 

.228  .221 

Caus 

.059 

.093 

.079j^ 

.140 

.103  .118 

.199 

.196  .197 

Total 

.136 

.102 

.100 

.076 

.236 

.178 

*F  (1,855)  = 
**F  (5,855)  = 

6.72, 
10.34; 

p  =  .01 
p  =  .001 

r  .*F  (1,855)  =8.03, 
p  =  .005 
**F  (5,855)  =  6.60, 
p  =  .001 

*F  (1  ,855)  =  13.11, 
,  '           p  =  .  001 
**F  (5,855)  =  3.81, 
p  =  .002 

Type  X  Level : 

F(5,855)  =  3.58, 
p  =  .003 

Type  X  Level:    F(5,855)  = 
.69,  p  =  .634 

Type  X  Level :  F(5,855) 
=  1.11,  p  =  .354 

s 


Table  3.12 


History:   Mean  proportion  scores  for  whole  (ALLS)  relationship  propositions  identified 
by  embeddedmess  and  relationship  type. 


1.    A  scores  (explicit  recall) 
Level  * 

2.  B  score  (implicit/partial 

recal 1 ) 

Level* 

3.  A  +  B  scores 
Level* 

Type** 

High 

Low  Total 

High 

Low 

Total 

High 

Low 

Total 

Def 

.163 

.015  .07L 

.117 

.176 

.154 

.280 

.191 

.225 

Prop 

.155 

112  138 

.076 

.061 

070 

.230 

.173 

.208 

Examp 

.036 

.017  .030 

.165 

.149 

.160 

.201 

.166 

.191 

Comp 

.058 

.048  .055 

.045 

.056 

.048 

.103 

.104 

.103 

Temp 

.131 

.146  .139 

.096 

.068 

.080 

.226 

.214 

.220 

Caus 

.135 

.131  .132 

.174 

.141 

.154 

.309 

.271 

.286 

Total 

.107 

.092 

.108 

.092 

.215 

.184  . 

*F  (1.567  = 
**F  (5.567)  = 

6.i56.  p  <=  .001 
17.14.  p  =  .001  . 

.*F(  1  ,567)  = 

**F  (5.567?  = 
P  = 

2.01. 
.157 
15.64. 
.001  ^ 

*F  (1.567)  = 
P  = 

**F  (5,567)  F 
P  = 

7.84. 
.005 
5.87. 
.001 

Type  X  Level : 

F  (5.567)  =  .86. 
p  =  . 509 

Type  X  Level : 
-.31 .  p  = 

F(S.567)  = 
.906 

Type  X  Level : 
-.29.  p  = 

F( 5.567) 
.916 
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r^ecal lability.    For  History  texts',  causal,  temporal,  and  property  pro- 
positions are  favored  for  explicit  recall.    In  bqth  Biology  and  History 
texts,  comparative  propositions  are  not  well  recalled.   The  low  scores 
for  the  example  propositions  are  Interesting,  given  the  high  frequency 
with  which  they  occur,  maldng  up  27%  of  total  number  of  propositions  In 
History  texts  and  19%  of  those  In  Biology. 
Expllcltness  by  Relationship  Type 

Mean  proportion  scores  for  whole  propositions  categorized  In 
terms  of  relationship  type  and  expllcltness  are  reported  In  Tables  3il3 
and  3. 14.    Tables  9  to  12  in  Appendix  F  provide  a  summary  of  the  same 
.Information  for  the  concept  parts  and  relationship  parts. 

Discussion 

Several  cautions  are  In  order  before  we  can  draw  conclusions  from 
the  data.    Mo^t  Importantly, although  we  attempted  as  much  as  possible  to 
gather  our  data  on  the  learnabili'ty  of  text  urjder  as  naturalistic  study 
conditions  as  we  could,  we  came  nowhere  near  reaching  that  goal.  Stu- 
dents were  faced  with  a  study  and  testing  situation  that  was  unusual 
for  them,  presented  by  an  outsider,  and  restricted  In  terms  of  time 
to  one  cli^ss  period.    They  could  not  ask  questions  or  discuss  content 
while  they  read.    They  were  tested  under  free  recall  Instructions  to 
produce  everything  they  remanbered  from  a  text.    And,  wh11e  most  stu- 
dents worked  Industriously,  a  significant  number  were  observed  to  be 
.  less  than  cooperative.    These  conditions  should  be  kept* In  mind  as  we 
draw  generalizations  from  our  results. 

The  overall  level  of  recall  taking  Into  account  any  proposition 
recalled  either  explicitly  or  Implicitly  nevfer  exceeded  21%  for  either 
History  or  Biology  texts.    Students  seemed  to  have  great  difficulty 
recalling  Information  that  authors  only  Implied  In  their  texts,. 
Example  propositions.  Ideas  that  state  that  a  concept  Is  tied  to  another 
by  virtue  of  being  Its  example,  were  surprisingly  vulnerable  In  students 
recall . 

On  a  more  positive  note,  students  were  sensitive  to  the  centrality 
of  any  Idea  In  that  they  favored  Ideas  high  In' text  structure,  closely 
^  tied  to  the  main  topic  and  silb-toplcs  of  a  text.    This  finding  Is  In 
agreement  with  results  stemming  from  a  number  of  other  studies  (Pichert 
and  Anderson,  1977,  and  Meyer,  1975)  and  lends  validity  to  the  concept 

.  ^'  .  .  r.   ,    ■     •  '  9i 
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Table  3.13 


^ 

Biology:'   Mean  proportion  scores  for  whole  (ALLS)  relationship  propositions  identified 
by  explicitness  and  relationship  type. 


1.    A  scores  (explicit  recall) 
Explicitness* 

2.    B'score  (ini^lici t/partial  i 

recall ) 

Explicitness*  • 

3.   A  +  B  scores 
£xplicitness* 

Type** 

Imp 

Total 

Imp 

.  Exp 

Total 

Imp 

Exp 

Total 

Def 

.050 

.243 

.204  / 

.123 

.090 

.097 

J73 

.333 

.30T 

Prop 

.119 

.158 

.151  , 

.105 

.066 

.074 

,224 

.225 

.225 

Ex  amp 

.044 

.078 

.056 

'  .138 

.114 

.129 

.182 

.193 

.186 

Comp 

.033 

.073 

.061 

.069 

.  .050 

.056 

.102 

.123  . 

.117 

Temp 

.122 

.111 

.  .118 

.115 

.080 

.103 

.237 

.191 

.221 

Caus 

.020 

.098 

.079 

.069 

-.134 

.118 

.089 

.232 

.197 

Total 

.077 

.139 

.115 

.176 

•  .192/^ 

^^215 

*F  (1,855)  = 
♦*F  (5,855)  ^ 

7.70,  p 
7.43,  p 

=^  .006. 
=  .001 

*F  (1,855) 
P 

♦*F  (5,855) 
P 

=  6.32, 
=  .012 
=  4.32, 
=  .001 

*F  (1,855)  = 

**F  (5,855?  = 
P  = 

.58, 
.444 
3.72, 
.002 

Type  X  Exp: 

F(5,855) 
'  P 

=  .77, 

=  .572  . 

Type.  X  Exp: 
1.16,  p- 

F  (5,855)  = 

=  .327  ; 

Type  X  Exp: 
.1.11,  p  = 

F  (5,855) 
.354 
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Table  3.14 


History:    Mean  proportion  scores  for  whole  (ALLS)  relationship  propositions  identified 
by  explicitness  and  relationship  type 


1 .  A 

scores  (explicit  recall) 
Explicitness* 

2.  B  score  (implicit/partial  , 

recall) 

Explicitness* 

3.    A  +  B. scores 

Explicitness* 

1  y  pc 

Imp 

Exp 

Total 

« 

Imp 

Exp 

Total 

Imp 

Exp 

Total 

Def 

0 

.094 

=.071  ■ 

,056 

.186 

.154 

.056 

.281 

.225 

Prop 

.100 

.149 

.138 

.067 

.071 

.070 

.167 

.220 

.208 

Examp 

.031 

.028 

.030 

.166 

.148 

.160 

.197 

.176 

.191 

Comp 

.027 

.065 

.055 

.041 

.051 

,048 

.067 

.116 

.103 

Temp 

.107 

.183 

.139 

.090 

'  .067 

.080 

.197 

-.250 

.220 

Caus 

.132 

.  l"33 

.132 

•  149 

.158 

.154 

.281 

.291 

.286 

Total 

.068 

.124 

.122 

.088 

.190 

.212 

*F  (1.567)  = 
**F  (5,567)  = 

6.50,  p 
12.32,  1 

=  .011 
p  =  .001 

*F 
**p 

(1  .567)  = 
(5,5675  = 

.04, 
.847 
13.42, 
.001 

*F  (1,567) 
P 

**F.  (5,567) 
P 

=  2.94, 
=  .087 
=5.28, 
=  .001 

Type  X  Exp: 

F(5,567) 
P 

=  1.07,  / 
=  .376 

Type  X  Exp: 
.62,  p  = 

F(5,567)  = 
.688 

Type  X  Exp: 
'1.13,  p 

F(5,567) 
=  .345, 

of  etnbeddedness  as  defined  by  our  relational  mapping  analysis.  s 

Our  major  reconmendatlon  to  textbook  authors  based  on  our  findings 
is  that  they  consider  making  th^  connections  between  ideas  more  explicit, 
particularly  when  relating  concepts  that  are  crucial  to  the  development 
'    of  a  topic.   To  teachers.  We  suggest  that  they  examine  their  textbooks, 
.and  perhaps  their  lectures,  for  instances  of  important  information  not 
explicitly  tied  by  a  relationship  marker  to, other  information  in  the 
text.    We  are  of  course  awarfe  that  there  are  many  potential  uses  of  a 
textbook  in  a  classroom  and'as  many  ways  of  selecting  information  to  be 
emphasized  and  tested.  In  classrooms  where  the  teacher  generally  asks 
very 'specific,  low  level  (detail)  questions  that  are  explicitly  stated 
in  the  text,  otir  recommendations  will  not  suit.    However,  in  classrooms 
where  tests  measure  how  wel 1  students  are  getting  the  broad  "picture"  of 
a.  topic,  and  where  they  are  expected  to  leirn  frojn  their  textbooks, 
teachers  should  be  awar6,  we, believe,  of  the  special  difficulties 
incurred  by  the  texts  they  assign. 

.  '  References  •  • 

Meyer,  B.  J.  F.    The  organization  of  prose  apd  its  jeffect*on  memory. 

Amsterdam:    North-Holland  Publishing  Company,  1975., 
Pi  chert,  J.  W.,  &  Anderson,  R.  C.    Taking  different  persnect-ives  on 
a  story.    Journal  of  Educationl  Psychology,  1^77,  69,  309-315. 


ERIC 


94 


3.46 


PART  4:    TOPIC  CONTINUITY  AND  COHESION:    ASPECTS  OF  COHERENCE 

Our  desire  to  study  coherence  stemmed  from  our  Interest  In  examining 
those  text  characteristics  that  contribute  to  how  well    a  test  fits  to- 
gether or  coheres  for  a  reader.    JFor  this   purpose  we  decided  to  examine: 
1)  the  extent  to'which  selected  cohesive  ties  contributed  to  or  detracted 
from  coherence,  and  2)  the  general  continuity  or  topical  flow  across 
se|fences.  ^ 

Cohesive  Ties 

Cohesion  Is  described  by  Halllday  &  Hassan  (1976)  as  providing 
the  linguistic  mortar  by  which  sentences  are  held  together.    For  exampVe, 
In  the  sentences 

Why  are  protozoa  cal led  animals? 
TTiey  voraciously  consume  their  food  In  chunks. 
They  arie  active  and  responsive.  ; 
They  and  their  are  cohesive  Items  presupposing  the  word  protdzoa. 
Together,  the  presupposing  and  presupposed  Items  define  a  cohesive  tie. 

There  are  several  types  of  such  ties.    There  are  reference  ties 
whose  pronouns,  usually  In  one  sentence,  presuppose  some  noun  or  noun^ 
phrase  In  another  sentence  as  In  the  example  tfbove.    There  are  sub- 
stitution £ies  where  words  such  as  one  substitute  for  and  thereby  pre- 
suppose  previous  reference vto  a  noun  or  noun  phrase.    There  are  ties 
of  ellipsis  where  the  a|)sence  of  a  presupposing  Item  assumes  a  pre- 
supposed Item  0^"  phrase.    There  are  ties  of  conjunction  where  connectives 
are  useH  to  relate  sentences.    Finally,  there  are  lexical  ties  where  - 
Items  are  tied  by  reiteration  or  collocation,  where  Items  have  the 
semantic  potential  of  appearing  together  In  a, text.    In  Halllday  & 
HassanJs  Cohesion    In  English,  the  description  of 
the  totality  of  s^uch  ties  In-a text  constitutes  the  text 's  cohes1on--the 
extent  to  which  a  text  ts  Internally  and  formally  coherent. 

In  describing  the  cohesion  of  our  texts,  we  were  not  Interested 
In  providing  a  statistical  account  of  the  number  of  ties  that  exlst,^ 
for  .any  sljigle  text  or  set  of  texts.    Instead,  we  were  Interested  In 
Individual  Instances  of  ties  and  the  extent  to  which  they  were  apt  to 
disrupt  the  construction  of  meaning  as  a  student  reads, a  text. 

In  a  related  study,  Tierney  &  Mosenthal  (1980)  had  examined  the 
relationship  of  a  statistical  accounting  of  ties  to  coherence  rankings 
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of  text.    In  their  study,  a  design  was  set  up  which  afforded  comparisons 
of  the  numbers  of  ties  across  a  range  of  writing  samples  on  the  same  * 
topic  and  with  the  same  structure.   They  found  that  cohesive  analysis  did 
not  predict  or  determine  textual  ^coherjphce  f(/r  a  reader.    To  establish 
this,  studpnt^ sriters  wrote  on  two  different  topics,  with  one^group 
of  them  familiar* with  one  of  the  topics,  jj  Cohesive  analysis  of  the 
students'  texts  revealed  significant  drvfrerences  between  texts  written  on 
the  two  different  topics,  but  no  dlffer^ce  between  familiar  and  un- 
familiar writers  writing' on  the  same  topic.    In  oth§,r  words,  cohesion 
was  more  a  consequence  than  a  .determinant  of  content  coherence.  Of 
relevance  to  present  analyses,  Tierhey  &  Mosenthal  argued  against  com-  - 
Sparing  ties  across  texts  or  assuming  any  number  6f  ^tles  was  a  predictor 
of^coherence..  Instead,  their  data  encouraged  us  to  examine  individual  ^ 
Instances  of  ties  wlthlrf  passages^    As  Tierney  &  Mosenthal  (1980)  asserted 
'we  saw  the  value  of  the- cohe.slon  concept  was  In  singling  but  Indlvl- 
dual  Items,  for  example,  anaphoric,  connective,^  lexically  cohesive 
Uems,--as  possible , sources  of  ambiguity  or  disruptions  of  the  re^t^er.  ' 
From  this  perspective,  we  were  not  Interest  In  the. Identification  of 
global  coherence  but  In  the  location  of  ambiguous  Instances  that  might 
detract  from  local  coherence  of  the  text.  '  ,  ■  ' 

Method 

Materials.    From  our  pool  of  over  30  text  samples,  we  selectQd* 
eight  passages  for  our  analysis.    These  passages  represented  a  w1fl€^  .  . 
array  of  topics  from  both  history  and.  biology  (iSf  101 -frogs,  #105-muscles,  , 
l!H12-reproduct1on  In  fishes,  i?03-snal5es,  i225-Roosevelt ,  *219- 
ranchlng,  #226-depress  Ion,  #223-dust  bowl  years;  see  Appendix*!))  and* 
a  variety  of  patterns  (time-sequence,  cause-effect,  ^rompape'stiyntrast). 

Cohesion  analysis.    Our  analysis  of  Individual \^t1es  pliocee4jBd  as 
follows.    First,  coheslveMtems  (instances  of  refer«he^,  jfeubstltutlon 
and  ellipsis)  were  identified  and  categorized.    To  trace  the  referent 
of  these  ties,  we  looked  first  In  the  sentence  directly  procee^lng^ the 
Item,  continuing  to  go  back  until  the  referent  was  located.    On  only 
a  /few  occasions  was  the  referent  found  In  a  sucteeding  sentence  (a-  ^ 
cataphoric  reference).    In  addition,  we  recorded  the  distance  between 
the  presupposed  Item  and  the  referent  by  counting  how^any  sentences 
away  the  antecedent  was.  Table  3.15  represents  an  exanfple  of  the  type 
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Table  3.15 


Inter- 

Sentence 

Cohesive  Ties 

Line 

Cohesive  Iteni. 

-  Type/ Ease  of 

'  Rpsnliitioh 

. Where' Resolved  , 

Distant 

I-  

1  . 
2 

he  : 

this 
him 

Ref. 

.  Ref. 
■  Ref. 

PR/1 

DR/3 
PR/1 

^  *      crisis  ^ 
^  1  (Rooseyelt) 

same  S 

IS. 
1  s 

A 

he 

they 

Ref. 

PR/1  . 
RP/1 

1  (Roosevelt) 
same 

2  S 
same  S 

4 

the  (President) 
he 
them 
he 

Ref. 
Ref. 

'  Rpf 

Ref. 

DR/3 
PR/1 
PR/1 

PR/1 

1  (Roosevelt) 

i    V  r\UU5cVc  1  I.  ; 

'  same  (laws) 
1  (Roosevelt) 

3  S 
3  S  ' 
same  S 
3  S 

5 

jjther 
(legislation) 

Ref. 
Ref. 

CR/1 
PR/a  , 

same  (laws) 
1  (Roosevelt) 

satne  S 
•       4  S 

6 

hf\s 

Ref. 

PR/1 

1  ( Rnn^evel t)  ^ 

7 

Ref. 

PR/1 

T    (  Dnnco\/o1  t  i 
1    V  r>U  U  ^  c  V  C  1  t  / 

.  5  S 

8 

one  \ 
another  a  " 

ne    \  ^  . 

Ellipsis  NE/1 
EllipsfsNE/1 
Ref.  PR/1 

same  v  p i ay s  j 
same  (plays) 
1  (Roosevelt) 

■  same  S 
same  S 
6  S 

9 

better  thaVi 

Ref. 

CR/1 

same 

same  S 

10 

that  A 

Ref.. 

DR/1 

same  (program) 

same  S 

11 

that  \ 

Ref. 

DR/1 

same  (program) 

1  o 

same  S 

12 

he-.    ,  \ 

it 

Ref. 
\  ftef. 

PR/ 1 
PR/3 

same  (Wilson) 
10  (New  Deal ) 

same  S 
1  S 

13 

It 

1, 

\  Ref. 

\  ■ 

PR/ 2 

10  (New  Deal ) 

2  S 

\ 

\ 

\ 
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of  analysis  that  we  conducted  for  each  of  our  eight  texts.    The  analysis 
displayed  Is  for  text  #225,  First  phase  of  the  New  Deal :  Try  Something. 

Procedure.    For  purposes  olF  determining  the  degree  of  ambiguity 
and  significance  of  the  various  ties,  studertts  were  asked  to  assess  the 
ease  of  resolution  and  Importance  of  each  tie.    Each  presupposing  word 
was  Italicized  and  under  the  word  was  placed  two  response  slots.  One 
response  slot  was  marked  "E:  for  Ease  of  resolution;  the  second  Item 
was  marked  "I"  for  Importance.    An  excerpt  from  one  of  these  rating 
sheets  appears  In  Tabl6  3. 1&.  The  passages  were  then  presented  to  high 
school  students  whose  lask  It  was  to  rate  the  extent  to  which  referential 
I  Items  were  essy  to  resolve  and  the  extent  to  which  they  were  Important 

or  signlflcaht  to  understanding  the  text.    Specifically,  once  we  were 
sure  the  subjects  understood  the  notions  of  presupposed  Items,  presup- 
posing item  and  tie,  the  directions  given  to  each  subject  were  as 
follows:    "As  you  read  the  passage  for  the  first  time,  mark  the  ease  of 
resolution  under  each  italicized  word.    After  you  have  read  the  passage 
and  marked  the  ease  of  resolution  for  each  of  the  italicized  words,  return 
and  mark  the  importance  of  each  tie."    Marking  the  ease  of  resolution 
and  Importance  entailecl  rating  on  a  scale  from  one  to  five  the  perceived 
ease  with  which  an  antecedent  could  be  determined  (5  being  most  diffi- 
cult) and  the  Importance  of  the  tie  to  developing  an  understanding  of 
the  text  (5  being  most  Important). 

Since  the  tasks  required  of  the  subjects  were  quite  difficult  and 
time-consuming,^  we  asked  individual  students  to  respond  only  to  one 
of  the  eight  texts.    Each  text  was  rated  by  two  studertts  working 
independently.    Graphs  of  their  responses  appear  in  Appendix  G. 
Results  ^  , 

While  our  analysis  proceeded  on  the  basis  of  an  examination  of 
individual  Items  of  cohesion,  our. Interest  was  in  findings  that  would  " 
emerge  across  passage^  and  across  subject  areas.    Across  passages, 
referential  ties  were  the  most  frequently  occurring  type  of  cohesive 
element.    Pronouns  were  the  items  that  studertts  most  often  identified  as 
difficult  to  resolve  and  also^  Important.    WhetliLr  or  not  a  [particular 
tie  was  considered  Important  or  difficult  to  resolve  was  not  affected 
by  distance.    The  distance  between  antecedent  and  referent  fluctuated 
from  one  item  to  the  next  regardless  of  the  tie  and  did  not  have  any 
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.    Table  3.1-6 

Example  of  rating  sheet  for  ease  of  resolution  and 
importance  ratings 


"^First  Phase  of  the  New  Deal  :    'Try  Something" 

Roosevelt  came  into  office  with  no  very  clear  idea  of  how  he  was 

'     -         1  .  E   I  

going  to  deal  with  the  economic  crisis.    This  did  not  dismay  him.  'There 

2.  E         l_  3.  E  ^1  

is  nothing  to  do,"  he  said,  "but  meet  each  day's  troubles  as  they  come." 

k.  E         l_  5.  E   I  

Some  laws  were  passed  against  the  President's  wishes,,  but  he  signed  them  to 

6.  E_        I   ^     .7.  E         I  8.  E_  I  

head  off  something  he  lilted  even  less,  or  to  avoid  folding  up  other  1  eg  i  s  1  at  ion . 

9.  E_  I   10-  E_  l_ 

His  principal  contribution  to  the  New  Deal,  in  addition  to  dynamic  leadership 

I .  e'   l_ 

and  political  skill,  was  his  "try  something"  philosophy.    He  likened  himself 

12.  E         t_  "  13.  t  

to  a  quarterback  on  a  football  team  who  calls  plays,  and  if  one  does  not 

-  '        li»,  E   t  

work,  tries  another:    In  any  case,  he  felt,  action  was  hetter  than  inaction. 

15.  E         l_'  16,  E         l_  17.  E   l_ 

U  New  Deal  was  thus  no  carefully  worked  out  program,  1 i ke  that  of 

'      18.  E   I;  

Alexanier  Hamilton  in  the  Washington  administration,  or  that  proposed  by 

1  -  19.  E   I  

WoodrowWilson  when  he  took  office  in  1913.     Instead,  it  reflected  the  haste. 

\       .     20.  E_  I,   ■  21.  E   I  

which  wertt  with  trying  to  attack  the  depression  on  many  fronts  at  once. 
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ger^ral  Influence  upon  ImpoKtance, 

Across  social  studies  and  biology  passages,  the  individual  items 
with  the  highest  importance  ratings  tended  to  have  higher  difficulty 
ratings  In  science  texts  than  similar  Item^in  the  social  studies  text. 
This  suggests  that  the  science  passages  contain  more  instances  of  ties 
which  are,  at  the  same  time.  Important  and  difficult  to  resolve.  It 
is  reasonable  to  assume  that  these  items  are  more  crucial  than  those 
that  were  rated  difficult  to  resolve  but  low  in  Importance, 

Within  passages,  the  findings  isupport  the  results  df  Tlerney  & 
Mosenthal  (1980),    The  variation  across  ties  and  across  subjects  is 
prima  facie  evidence  of  the  problems'  associatedwith  trying  to  represent 
coherence  by  aggregating  across  cohesive  ties.    Although  the  overall 
correlations  between  subjects  for  the  six  passagea-'w^S  quite  high 
(.3  to  .4),  the  extent  to  which  the  rat1jj.^r^at*e-4rra€ic  across  the 
graphs  shown  in  Appendix  G     is  impres/lve,  ,  There  is  considerable 
variation  from  one  tie  to  the  next,  aM  even  for  the  same  tie  rated  ' 
by  different  readers.    Nonetheless,  .^^hin  every  one  of  the  eight 
texts,  there  were  some  ties  (usually  at  five)  which  readers 

agreed  were,  at  the  same  time,  diff icul t  to  r^Siil ve  and  important,  ^ 

To  explore  whether  there  were  certain  text  futures  associated 
with  those  ties  that  were  rated  as  crucial  and,  also,  difficuSct  to 
resolve  we  pursued  a  more  subjective  examination.    It  appeared  that 
a  variety  of  factors  were  contributing  to  the  ambiguity  of  these  ties,  ^ 
Sometimes  the  difficulty  seemed  related  to  vague  or  unfamiliar  ante- 
cedents.   At  other  times,  the  problem  seemed  to  be  related  to  the 
scope  of  the  antecedent.    For  example;  in  the  paragraph  below  the 
underl ined  elements  K identified  ^  important  &  difficult  to  resolve) 
have  antecedents  which  would  Ifkely  be  difficult  to  trace  unless  the 
reader  was  quite  knowledgeable. 

In  male  fish,  the  sex  organs  are  called  testes. 
These  develop  sperm  cells.    When  the  female  lays 
the  egges,  the  male  swims  over  them.    The  male 
discharges  milt  into  the  eggs.    Milt  is  a  fluid 
containing  sperm.    The    sperm  swims  to  the  eggs 
and  fertilze  them.    This  is  external  fertilization, 

(Talen  from  #112  Reproduction  in  Fishes) 

Sometimes  items  that  were  difficult  to  resolve  and  important  seemed 

associated  with  unannounced  shifts  in  the  topic.    For  example,  in 
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the' following  text,  the  shift  from  "snakes''  as  the  topic  to  "eyes," 
together  with  the  repetitive  use  of  "those"  for  "snakes"  Is  quite 
problematic. 

Different  snakes  have  different  shaped  pupils 
In  their  eyes.    Those  most  active  In  daylight 
have  round  pupils.    Those  most  active  at  night  ^ 
have  elliptical  pupils  similar  to  those  of  cats, 
(Tajcen  from  #103  The  Structure  of  a 
Snake^s  Head) 

Other  Instances    appear  to  be  associated  with  an  author's  failure  to 

clearly  establish  an  antecedent  or  a  frame  of  reference  that  the 

reader  would  "carry  with"  him  or  her  throughout  their  reading  of  the 

passage.    The  following  two  examples  are  taken  from  one  of  our  social' 

studies  text.    The  first  was  take^p  from  the  final  paragraph  of  text 

#225  which  discussed  the  New  Deal.    The  second  occurred  In  the  first 

paragraph  of  Passage  #219  on  ranching. 

Such  was  the  general  nature  of  the  Great 
rxperlment  that  President  Roosevelt  and  the 
Congress  launched  Irt  the  Spring  of  1933, 

In  this  example^,  "such"  referred  to  the  entire  discussion  dealing  with 

the  New  Deal  which  had  proceeded  for  a  couple  of  paragraphs.    We  would 

predict  that  some  readers  would  have  difficulty  with  this  cohesive  Item 

due  to  their  failure  to  realize  the  scope  of  Its  antecedent. 

By  the  1890' s  the  western  cattle  Industry  centered 
In  the  high  plains  running  through  eastern  Montana, 
^Wyoming,  Colorado,  the  New  Mexico  Territory  and, 
Western  Texas.    Most  ranchers  by  now  owned  their 
grazing  land  and  fenced  It  In  with  barbed  wire. 

In  this  example,  now  referred  to  1980  which  was  mentioned  In  the  first 

line,  but  never  re-established  clearly  or  fully,  > 

Concluding  remarks 

In  general,  then,  we  would  suggest  that  the  text  passages  that 

we  examined  included  several  ties  which  were  crucial  and  ambiguous. 

More  generally,  our  data  supported  our\earl1er  argument,  th^t  whether 

or  not  a  tie  Is  difficult  to  resolve  and  Important  varies  with  the 

following:    the  role  that  the  t16  plays  In  the  text;  the  topical 

development  that  has  been  and  Is  occurring;  the  reader's  familiarity 

with  the  content  being  presented    and  other  Idiosyncratic  characteristics 
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of  text,"  context,  and  reader.    If  we  were  to  offer  any  recommendation 
based  upon  our  datg  to  textbook  authors,  1t  would  be  to  establish  more 
clearly  the  topic  being  discussed,  expeclally  If  that  topic  Is  unfamiliar. 
Authors  should  recognize  that  the  use  of  pronominal ization,  synonymy 
and  other  forms  of  reference  may  cause  problems  for  the  reader  if  the 
reader  is  not  familiar  with  concepts  presented  and  is,  at  the  same 
time,  presented  with  text  densely  ladened  with  new  ideas.  » 

Topic  Continuity 
•   Our  second  probe  was^directed  at  examining  another  aspect  of 
coherence--top1c  continuity.    Our  desire  to  examlne*^ continuity  coin- 
cided with  our  interest  in  the  development  of  arguments,  themes  or 
topics  nithin  text  as  well  as  (Jur  concern  that  there  might  exist 
sudden  topic  shifts  disconcerting  for  many  readers.    The  notion  of 
topic  continuity  relates  directly  to  descriptions  of  coherence  offered 
by  van  Dijk  (1977)  who  suggested  that  sentences  be  assigned  a  topic- 
comment  structure.    This  approach  is  similar  to  Fries'  (1978)  notion 
of  theme/rheme.    In  a  topic-comment  analysis,  topic  is  determined  by 
examining  each  sentence  or  independent  clause  and  determinijig  "what 
it  is  about."    Comment  is  defined  as  that  part  of  the  sentence  or 
clause  that  specifies  what  is  unknown  or  new.    Discontinuity  occurs 
when  a  sentence  or  independent  clause  introduces  an  argument  which 
cannot  be  subsumed  under  the  same  frame  of  the  argument  or  predicate 
of  a  previous  topic.  ^ 

Two  questions  guided  our  analysis  of  topic  continuity:    Do  readers 
deem  the  ideational  development  that  unfolds  across  texts  to  be  continuous? 
And,  are  readers*  perceptions  of  continuity  related  to  selected  text 
characteristics? 
Method 

Materials  and  procedures.    The  texts  chosen  for  pur  topic  analysis 
were  six  of  the  eight  texts  used  for  the  cohesive  analysis.    These  texts 
were  broken  down  into  idea  units  and  presented  to  20  students.  The 
students  were  asked  torate  the  extent  to  which  ideas  presented  sequen- 
tially and  pair-wise  were  predictable  or  continuous  with  respect  to 
topic.    As  subjects  read  each  new  idea  unit,  they  were  asked  to  rate 
its  predictability  (from  "5%  very  predicatable  to  n\  very  unpre- 
dictable).   A  sample  of  the  text  and  rating  scale  are  shown  in  Tablets 
3.  1  7  and  3.  18. 


Table  3.17 


TOPIC  CONTINUITY 

Listed  are  parts  of  idea  units  (sentences  or  clauses)  taken  from 
social  studies  and  biology  texts  written  for  high  school  students. 
As  you  read  each  new  idea  unit  we  want  you  , to  assess  the  extent  to 
which  you  believe  each  new  Idea  unit  was  predictable  or  not.  That 
Is,  mark  the  extent  to  which  you  were  surprised  by  the  topic  of 
each  new  Idea  unit.  Mark: 


5  =  very  predictable 

4  >  predictable 

3  ■  only  somewhat  predictable 

2  «»  unpredlctabl  e 

1  »  very  unpredictable 


Pleaseuse  the  answer. sheet  to  complete  your  ratings. 


D 
E 
F 
G 
H 
I 


Answer  Sheet 


Name 


Rating:  First/Second 


Passage  or  first  1 ine 
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Table  3.18 


A 
B 
C 

0 
E 

F 

G 

H 

I 
J 
K 


RANCHES  AND  FENCES 


By  the  1890's  the  western 'cattl e  Industry  centered  1n  the  high 
plains  running  through  eastern  Montana,  Wyoming,  Colorado,  the 
New  Mexico  Territory,  and  western  Texas. 

Most  ranchers  by  now.iOwned  their,  grazing  land  and  fenced  it  in 
with  barbed  wire. 

Ranches  varied  in  sire  from  about  2,000  to  100,000  acres  (about 
800  to  40,5000  hectares). 

To  an  easterner,  accustomed  to  small  farms  of  a  f^l^undred  acres 
at  most,  western  ranees  seemed  enormous.  ^ 

But  the  ranches  had  to  be  large 

since  each  steer  required  a  grazing  area  of  15  to  75  acres  (or 
about  6  to  30  hectares) 

depending  upon  the  amount  of  rainfall  and  the  resulting  growth 
of  grass, 

li^^h  the  invention  of  better  instruments  for  drilling  into  the 
gr^uml  and  the  improvement  of  windmills  for  pumping  water, 

many  cattle  raisers  watered  their  stock  from  w^lls  scattered  /ver 
their  ranches.  / 

In  years  of  abundant  rainfall,  cattle  rancers  might  prosper, 

since  their  herds  could  fatten  on  the  natural  grasses. 

But  In  years  pf  drought  they  were  forced  to  feed  their  cattle 
hay  or  cottonseed  cake,  ^ 

a  costly  practice  which  often  wiped  out  their  profits. 
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Rating  analysis.    To  assess  the  continuity  or  Idea^  prlssented 
across  the  passage,  the  predictability  ratings  of  the  students  were* 
graphed  (see  Appendix  H),    The  graphs  depict  the  mean  predictability 
rating  (marked  with  an  X)  for  each  Idea  pair  and  the  range  of  responses 
of  all  subjects  to  that  pair. 

To  determine  whether  certain  text  characteristics  were  associated 
with  discourse  continuity  or  discontinuity,  students  were  asked  to 
explain  the  basis  for  their  ratings  of  the  text.    That  is,  students 
were  asked  to  explain  the  basis  for  any  assessment  of  predictability 
which  either  rose  or  dropped  at  least  two  categories  on  the  scale 
across  the  ideas  presented  in  the  text.  ' 

Topics-comment  analysis.    Finally,  to  support  our  assessment  of 
what  was  occurring,  the  predictability  ratings  were  compared  to  a  topic-/ 
comment  analysis  of  each  text  which  was  developed  from  the  maps  of  / 
the  texts.    The  procedures  fol lowed  for  these  analyses  were  as  follow/. 
First,  a  topic/comment  list  was  created  for  each  passage.    Topic  was| 
determined  by  examining  each  sentence  or  Independent  clause  and^ 
determining  "What  it  was  about.'*    Comment  was  that  part  of  the  sen- 
tence which  specified  "What  was  related  or  described  about  the  topic." 
The  following  section  from  a  social  stud1es|text  serves  as  an  example 
of  this  procedure: 

Text:  (1)    By  the  summer  of  1982  the  ^erican  economy  was 

close  to  rock  bottom.    (2)    National  income  had  dropped 
from  $81,000,000,000  to  $41,000,000,000.    (3)  The 
steel  industry  was  working  at  22  per  cent  of  capacity. 
(4)    Thousands  of  business  concerns  had  gone  into  bank- 
ruptcy and  thousands  of  banks' had  closed  their  doqrs.. 

SI  -  Topic     I  Comment 

(1)  ^   American  economy,  1932  -  was  close  to  rock  bottom 

(2)  National  income  -  had  dropped  significantly 

(3)  Steel  Industry  -  working  at  22%  capacity 

(4)  '  Businesses,  banks  -  bankrupt,  closed 

The  topic/comment  list  Included  all  sentences  from  the  text.  The 
next  step  was  to  group  the  topic/comment  lists  into  sub-topics.  Similar 
Ideas  were  chunked  together  by  first  determining  whether  topics  were 
Identical  or  synonymous.    When  topics  could  be  superordinated  under 
a  common  category,  the  comments  link'ed  to  those  topics  were  examined 
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to  see  If  they  too  shared  similarities.    These  relationship  categories 
guided  this  process:    description,  definition,  example,  process,  cause/ 
effect.    In  the  above  example,  the  four  sentences  ^are  related--they  are 
all  examples  of  business  condition.    Thus,  a  suggested  sub-topic 
emerging  from  the  topic/comment  list  give  above  Is: 


Sub-Topic  1  -  Business  conditions  during  Depression,  1982 
Sentences  1,  2,  3,  4 


Sentences  were  considered  in  sequential  order.    When  a  topic/comment 
combination  appeared  to  represent  a  new  topic,  it  was  listed  as  a  new 
sub-topic.    Thus',  the  amount  of  sentences  contained  within  sub-topics 
varied  across  and  within  texts.  f 
The  third  step  was  $,0  chart  the  sub- topics  in  a  linear  represen- 
tation.   In  Figure  3.6,    the  left  side  represents  the  mapped  version 
of  the  text  with  numbers  assigned  to  each  map  element.    The  right  side 
is  the  chart  of  topic  continuity,  with  the  numbers  corresponding  to 
map  elements  on  the  left.    Connective  relationshi ps  helped  define  the 
scope  of  topics  by  providing  cues  to  TYPES  of  relationships  between 
ideas  in  the  text.    Both  explicit  and  Implicit  connectives  v^re  examined. 
Connective  relationships  were  categorized  into  the, following  types: 
similarity  (examples,  definitions,  clarifications),  additive  (proper- 
ties,  conditions,),  adversative,  causal,  temporal  {simultaneous,  prpcedes, 
follows,  summary).    For  example,  the  text  reads:    ''The  change  to  an 
adultfrog  is  amazing,    first,  hind  legs  appear  on  the  tadpole's  fish- 
like  body."    Use  of  explicit  connective  FIRST  connects  elements  1,  2, 
and  3  to  4,  5,  and  6.    The  relationship  is  categorized  as  being  a- 
temporal  relationship,  describing  a  sequence  of  events.    Thus,  the 
topic,  continuity  chart  contains  a  description  of  whether  connections 
are  explicit  or  implicit,  and  a  classification  of  the  type  of  relation- 
Jhip  which  Joins  the  elements.  ^ 
Results 

Do  readers  deem  the  ideational  development  which  unfolds  across 
text  to  be  continuous?    The  predictability  ratings  prdvided  by  the 
studetns  suggested  that  topic  discontinuity  manifests  itself  frequently 

c 
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Figure  3.  6 
Chart  of  Topic  Continuity 


MAP 


(1)  Metamorphosis  of  the  frog 


(2)  DEF:  change  to  an  adult  frog 


(3)  is  amazing 


T 


(4) 
(5) 
(6) 


First  (phase) 


hind  >egs  appear  on  tadpol  e^s 
body  


Fish-like 


General  Topic:  Metamorphosis 
of  the  ffbg 


1.  2,  3 


C:  4 


Sub-Topic  1:  External  changes 
during  metamorphosis 


1,2.3  [first]  Explicit  Temporal 
  ^.5,6  


7 
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In  text  written  for  high  school  students.    Furthermore^  topic  con- 
tinuity or  predlctabll  Ity  does  not  occfur  or  Change  gradually  as  students 
progress  through  a  text.    Indeed,  predlctabll Ity  ratings  by  students 
often  changed  suddenly  and  these  changes  occurred  at  any  point  of  develop 
ment  In  the  text--beg1nn1ng,  middle  or  end.    Across  each  of  the  twenty 
students  who  rated  the  text »  there'  were  at  least  four  or  five  pairs 
of  Ideas  for  which  the  predictability  ratings  changed  at  least  two 
categories  (e.g.  very  predictable  to  only  somewhat  predictable)  and 
these  points  occurred  at  various  points  throughout  the  text. 

Are  readers^  p^ceptlons  of  continuity  related  to  selected  text 
characteristics?   There  appeared  to  be  s^wije  general  and  speclfld^ext 
characteristics  associated  with  the  students-  perceptions  of  continuity. 
In  general »  average  means  of  predlqtabJl^ty  were  lower  overall  for  the 
biology  passages  than        history  passages.    Also,  the  biology  passages 
appeared  to  exhibit  more  variability  U\  the  rated  predictability  of 
Idea  pairs. 

\^     Comparisons  b^ween  predictability  ratings  and  the  topic  continuity 
charts  Indicated  several  Interesting  findings.    In  most  cases,  dis- 
continuity occurred  Across  passages  at  transitional  locations,  where 
topic  shifts  occurrgj.    Low  predictability  rating  consistently  appeared 
whenever  topics  changed,  transtlons  between/sub-toplcs  wer*e  weak  or 
where  ri^rexpllclt  transition  existed.    For  example,  consider  the  fol- 
lowing  pair  of  Ideas,  identified  as  being  not  very  predictable:, 

In  male  fish,  the  sex  organs  are  called  testes. 
.These  develop  spenn  cells. 
When  the  female  lays  the  eggs».-. 

(Taken  from  #1K,  Refyroductlon  In  Fishes) 

Those  with  fixed  Incomes,  *such  as  college  professor^y. 
were  actually  better  off  because  prl^  declined. 
Although  the  bottom  Tiropped  out  of  the  new  car 
market ,  enough  people  managed  to  hold  on  to  their 
old  ones"  sq  that. . .  *^  i 

(Taken  from  #226,  Rock  Bottom)  ^ 

Both  examples  represent  situations  where  an  author  introduced  a  n^ 
idea  whose  relationship  with  what  has  preceded  is  not  readily  apparent. 

In  other  places  within  texts,  what  is  deemed  not  very  predictable, 
is  left  almost  totally  dangling.    In  the  following  examples  the  rela- 
tionship of  the  new  1dea--the  last  idea  presented--  to  the  text  which 
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precedes  it;is  never  clarified.  , 

ertough  people  managed  to  holH  on  to  their  old  ones  so 
that  the  use  of  gasoline  did  r^ot  decrease.  Cigarette 
prices -rose  steadily."'  \  ;  '  . 

(Taken  frora  #226,  Rock  Bottom) 

In  support  ofithese  findings,  when  we  asked^our  students  to  explain 
their  ratings,  the  comments  offered  most  frequently  echoed  our  own 
analyses.    For  example,"  among  the  more  frequent  responses  offered  by 
Students  w.ere. statements  such  as  the  following: 
"the  text  has  a  problem  in, logic"  ' 
"tie  new  topic  or  idea  was  not  set  up" 
'  -  "|uthor  could  have  gone  in  a  number  of  directions, 
leed  more  information  prior  to  new  direction" 
,if'no  steps  to  new  ideas" 
,/;  "seems  unrelated" 
'f^  "why  "this  comment,  L  don't  know." 
Finally,  in  our  analyses  of  the  text,  we  were  interested  in 
whether^  or  not  we  might  be  able  to  forecast  which  pairs  of  idea  students 
would  deem  predictable  or  unpredictable.    As  we  have  suggested  already, 
point.s  of  greatest  and  least  continuity  coincided  with  topic  shifts 
and  limited  transitions  depicted  on  our  maps  and  topic -comment  listings. 
However,  several  of  the  topic  shifts  that  were  identified  by  our  analyses 
we4  not  among  those  pairs  of  ideas  that  students  deemed  least  continuous 
Our  text  analyses  suggested  that  each  text  contained  between  three  and 
seven  topic  shifts  that  might  be  rated  as  relatively  less  predictable. 
The  students'  ratings  suggested  that  the  predictabil ity  of  the  texts 
at  these  points  was  not  always    diminished.    As  our  examples  and  the 
comments  provided  by  students  partly,  il lustrated ,  there' were  several 
factors  which  "contributed  to  discontinuity  that  our  analyses  did  not 
measure.    Still  in  all,  it  would  seem  that  a  topic-comment  analysis 
together  with  an  examination  of  the  connectives  would  predict  several 
of  the  points  which  were  less  predictable. 

In  summary,  our  findings  with  respect  to  topic  continuity  suggested: 
1)  topic  discontinuity  manifests  itself  frequentl-y  in  informative  text 
written  for  high  school  students;  2)  as  a  group, ^the  biolpgy  texts 
included  more  topic  shifts  and  more  points  withj^the  text  that  students 
rated  as  less  predictable;  3)  discontinuity  across  passages  was  detected 
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most  frequently  at  transitional  locations,  where 
topics  were  either  weak  or  lacking;  4)  among  the 
students  suggested  as  contributing  to  discontinui 
failure  to  set  up  adequately  the  presentation  of 
"bffered  by  students  suggested  that  topic  disconti 
improved  if  authors  provided  additional  transitiqna^l  information  or 
an  explanation  of  their  logic. 


transitions  between 
major  factors/that 
ty  was  the  authors* 
new  ideas.  Comments 
nuity  woiild  be 
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PART  5:    PATTERNS  OF' TEXT 
Diane  L.  Schallert,  Sarah  L.  Ulerick,  David  Lydic 

What  differentiates  text  from  a  list  of  unrelated  sentences  is  that  the 
sentences  of  a  text  somehow  cohere  together  and,  as  a  whole,  present  an  invitation 
to  the  reader  to  construct  a  pattern  of  ideas  that  represents  the  structure  of 
the  author's  message.    Over  the  last  15  to  20  years,  psychologists  have  moved 
to  an  increasing  use  of  extended  text  as  experimental  materials.    In  describing 
the  stimuli  presented  to  subjects%  they  have  found  themselves  needing  some  system 
for  describing  the  general  structure  underlying  the  presentation  of  ideas . 
Since  most  investigators  of  extended  text  have  used  narrative,  story-like 
materials,  it  is  not  surprising  that  the  one  structural  pattern  most^  developed, 
tested,  and  critiqued  has  been  story  grammar  (Marjdler  &  Johnson,  1  977; 
Rumelhart,  1  975;,  Steip  &  Glenn,  1979).    The  general  explanatory  value  Of  story 
grammar  is  that  it  affords  the  text  analyst,  and  theoretically,  the  story 
reader,  with  a  system.for  identifying  the  function  that  any  one  piece  of  text 
is  playing  and  for  predicting  what  kind  of  information  is  likely  to  appear. 

Informative  text  has  not  so  far  been  formally  described  with  a^^^structu^al 
system  or  grammar  of  its  own.    Rhetoriticians  have  described,  or  rather,  prescribed, 
major  modes  of  presenting  ideas  such  as  the  comparison  structure,  the  descriptive 
structure,  and  so  on.    However ,^ these  patterns  have  not. been  empirically  demon- 
strated either  to  occur  regularly  in  natural  text  or  to  have  some  important 
psychological  effect  on  text  processing.    One  notable  exception  is  a  report 
by  Niles  (1  965)  in  which  he  Siig'gested  that  all  writing  has  some  kind  of  organization 
or  structure  --  even  though  the  structure  may  be  a  deliberate  lack  of  structure. 
He  proposed  further  that  organizational  patterns  emerge  in  various  forms  and 
combinations  and  may  be  a  key  to  distinguishing  not  only  between  such  super- 
ordinate  categories  a(^s  narrative  and  expository  but  within  them  as  well  .  Based 
on  an  informal  analysis  of  paragraph  structure  "in  Secondary    level  social 
studies,  science  and  language  textbooks,  Niles  C19!65)  found  the  major  patterns 
In  order  of  frequency  to  be  enumerative  order  (simple  listing),  time-wder, 
cause-effect  and  comparison-contrast. 

Having  begun  a  major  investigatioh  of  informative  text  characteristics, 
we  became  interested  in  patterns  of  text  structure.    The  main  impetus  for  our 
interest  came  from  the  process  and  product  of  mapping  texts,  producing  a  visual  ^ 
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display  of  the  coherent  relationships  that'hoTd  a  text "together .    These  displ ays 
differ  from  text  to  text  but  do  high!  ight  some  resembHnces  that  might  have 
remained  obscure  were  it  not  for  th'e  maps.    In  looking  at  the  maps  of  our  sample 
of  texts  taken  from  naturally  produced  textbook  discourse,  we^were  stfipk  not 
so  much  by  invariant,  recurring  patterns  but 'by  the  tiybrid  combinations  of 
relationships  t ha*  held  at  different  levels  of  embeddedness.  Furthermore, 
our  sample  of  texts  seemed  to  range  from  relatively  pure  and  simple  patterns  to 
more  complex  combinations  involving  less  predictable  patterns  of  text.        -  , 
to  test  our  intuitive  evaluation,  we  devised  a, categorization  task  that 
instructed  subjects  to  group  together  maps  (and  texts)  that  seemed  similar 
in  terms  of  overall  structure.    The  groupings  were  submitted  to  a  cluster 
analysis.    In  addition,  the  subjects  were  asked, to  rate  how  similar  each  map 
was  to  their  idea  of  the  general  pure  pattern  denoted  by  four  labels, 
"description,"  '^comparison "chronology,"  "causal  description." 

Method 

Subjects 

The  sixteen  participants  were  divided  into  two  groups.    The  expert  group 

was  comprised  of  seven  gra^duate  stu^^^^^   

experimenter  (OLS)  who  had  extensive  training  in  mapping.    The  non-expert 

group  was  composed  of  nine  graduate  students  who  had  participated  in  one 

seminar  session  on  mapping  as  part  of  a  graduate  course  on  discourse  analysis. 

Materials  and  Procedure 

'  The  participants  worked  privately  and  at  their  own  pace  in  two  sessions. 
At  the  first  session,  the  non-expert  group  received  a  quick  refresher  Cf 
mapping  along  with  a  summary  of  the  symbols  and  their  meaning.    They  (as  well  ^/ 
as  ]the  expert  group)  received  copies  of  the  30  maps  that  comprise  our  text 
sample  (see  Appendix  0)  along  with  iflstructions  to:  ^ 

"Categorize  the  maps  into  groups  that  reflect 
any  structural'  similarities  that  you  perceive. 
We  are  interested  in  similarities  in  the  broad 
organization  of  ideas.    We  are  not  interested  in 
«  grouping  based  upon  superficial  similarities  such  as 
subject  mertter,  details  of  wording,  quality  of  ' 
xerox,  size  of  map,  etc.  ."^ 

{  :  ' 
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There  is  no  correc/To^^ 
grouping  the  maps.    The  only  guideline  is  that  there 
be  at  least  2  groups  and  no  more  than  10  groups." 

The  procedure  of  grouping  the  maps  took  anywhere  from  30  to  90  minutes.  Once 
the  students  had  formed  their  grofeps  they  were  asked  to  provide  a  label  or  a 
rationale  for  the  groups. 

The  second  procedure  was  derived  from  the  first  and  was  administered  to 
the  same  subjects,  7  to  10  days  following  the  first  procedure.    Based  upon  an 
informal  analysis  of  the  grouping  offered  by  the  participants  above,  four  major 
categories  were  detected.    Three  of  these  were  easily  labeled  by  two  experimenters 
working  independently  as  representing  description,  comparison,  and  chronology 
or  process.    The  fourth  grouping,  was  s^lightly  more  diff icul t  to  label.  Concepts 
were  presented  and  a  number  of  medium  and  low 'level  causal  relationships 
appeared  in  this  group.    We  eventually  agreed  on  the  label,  "causal  description 
of  concepts 

When  the  participants  appeared  for  the  Second  procedure,  they  again  received 
the  30  maps  (randomly  ordered)  and  the  following  rating  instructions: 

The  first  time  we  had  you  look  at  these  maps, 
we  asked  you  to  group  them  in  terms  of  structural 

 similarity,  We  have  looked  at  your  groupings  and  have 

arrived  at  the  following  four  main  categories: 

category  1 :    Description  of  Concepts 
About  a  Topic 
,  category  2:    Comparative  Organization 
category  3:    Chronological  Organization 
category  4:    Causal-  Description  of  Concepts 

Some  maps  may  seem  to  fit  exactly  one  category.  Some 
*  may  be  good  examples  of  two  or  more  categories.    And  . 
some  may  not  seem  to  fit  into  any  category  very  well . 

Your  task  now  is  to  take  each  map  and  rate 
how  close  it  comes  to  representing  as  a  whole  the 
structure  implied  by  each  category.    Your  ratings 
should  not  merely  reflect  the  proportions  of  relationships 
implied  by  the  category  labels.    For  example,  the  ^ 
degree  to  which  a  map  fits  into  the  "Causal  Description 
of  Concepts"  category  is  not  necessarily  determined 
by  the  proportion  of  causal  relationships  shown  1n 
the  map.    Rather,  in  doing  your  ratings,  try  to 
1)  view  each  map  as  a  structured  whole,  2.)  compare  each 
map  with  what  you  would  See  as  an  "idealized"  example 
of  each  of  the  four  categories,  and  3)  rate  the  similarity 
between  the  real  map  and  idealized  categories. 
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The  ratings  wen^^^lfS^d  on  a  six-point  scale  with  1  =  "a  perfect 
match, "'2     ''quite  similar,''  3  =  "somewhat  similar,"  4^=  "somewhat  ^ 
different,"  5  =  ."quite, different ,"  and  6  =  "not  at  all  similar." 
'Ratings  were  nfarked  on  grids  that  listed  the  texts  on  the  left  side 
and  gave  the  four  category  labels  in  columns  next  to  each  text.  . 
i  Results 
To  score  the  participants'  categorizations  of  the  maps,  a  30 
(texts)  by  30  grid  was  constructed,  yielding  cells  defined  by  one 
text  on  the  horizontal  and  one  on  the  vertical.    Tallies  were  entered 
for  each  subject  in  every  cell  that  represented  two  texts  placed 
together  in  the  same  category.    The  cell  frequencies  were  then 
turned  into  two  proportions:  (1)  the  proportion  of  experts  (denominator 
^  7)  that  had  placed  the  cell's  two  texts  together;  and  (2)  the 
proportion  of  all  participants  (denominator  =  16)  that  were  represented 
in  that  cell.    These  proportions  were  entered  separately  into  multi- 
dimensional scaling  analyses  and  a  four-factor  solution  was  found. 
These  solutions  have  not  been  explored  further,  at  this  time. 

The  proportion  scores  can  also  be  visually  inspected.  In 
Table  3.18.  we  list  the  proportions  of  experts  and  of  the  total 
sample  who  paired  a  particular  text  with  another.    The  table  is 
organized  text  by  text  and  the  order  of  entries  under  each  text  is 
determined  by  the  relative  strength  of  association  with  other  texts. 
In  listing  associated  texts,  a  cut-off  score  of  .35  was  used.  A 
text  is  listed  if  at  least  one  of  its  associated  proportions  in  more 
than  .35. 

Some  characteristics  of  the  categorization  proportions  should 
be  noted.    First*  every  text  is  grouped  with  at  least  one  other  text, 
indicating  that  none  of  our  texts  were  perceived  as  truly  unique. 
Second*  the  strength  of  association  varies  dramatically  from  text 
to  text.    For  example*  Text  #101  has  expert  proportion  scores  of 
.85  with  Text  flfl02  and  #222;  Text  #106  does  not  have  any  proportion 
score  higher  than  .42.    Third,  some  texts  are  associated  with  m|iny 
others  (e.g..  Text  #103)  whereas  others  have  relatively  few 
associates  (e.g..  Text  #106).    Fourth,  experts  and  non-experts  , 
generally  agree  at  least  as  to  the  order  of  any  text's  associates, 
although  occasionally  there  is  a  wide  disparity  (e.g.,  Text  #225). 
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\    Table. 3. 18 
Proportions  of  Concurrence  for  Pairs  of  Texts 
Derived  for  Mapping  Experts  and  for  All  Ss 


Text 

if 

Prop. of 
Experts 

Prop. of 
All 

Text 

if 

Prop. of   Prop. of 
Experts  All 

Text 

Prop. of 
Experts 

Prop. of 
All 

TEXT  §  101 

TEXT  §  104 

TEXT  #  108 

• 

222 

.85 

.75 

102 

:85 

ins 

71 

.43 

102 

.85 

.56 

222 

.85 

997 

•  Of 

31 

104' 

.71 

.50 

112 

.71 

lid 

112 

.71 

.43 

228 

.71 

1  U  J 

d*? 

223 

.42 

.43 

223 

.42 

.43 

1 1  3 

■31 

228 

.42 

.43 

9  90 
CCD 

1  d 

TVT  u  inc 

TEXT  § 

102 

TEXT  if  109 

■ 

,108 
230 

,  .71 
.57 

.43 

.  J/ 

222 

1 .00 

.63 

218 

.57 

.43 

101 

.85 

.  56 

110 

.57 

T1 

.  J  u 

115 

.42 

.50 

104 

.85 

.56 

114 

.42 

.37 

217 

.42 

.37 

112 

.57 

.56 

221 

.42 

.24 

226 

.42 

.24 

228 

.57 

.56 

227 

.'42 

.18 

103 

.42 

.24. 

223 

.28 

0  .37 

112 

.42 

.24 

114 

.28 

.37 

TEXT  if 

103 

229 

'       .  28 

.37 

107 
221 
225 

.42 
.42 
.42 

.37 
.37 
.37 

226 

.85 

.63 
.56 

TEXT  #110 

111 

.57 

229 

.57 

.43 

219 

.42 

.31 

221 

.57 

.37 

218 

.57 

.24 

mi 

105 

.57 

.31 

110 
227 

.42 
.42 

.56 
.43 

TEXT  n07  • 

103 
223 

".42 
.42 

.56 
.37 

108 
219 
105 
109 
116 

«  .42. 
.42 
.42 
.42 
.28 

.43 
.31 
.31 
.24 
.37 

220 
219 
116 
106 

.57 
.57 
.57 
.42 

.56 
.43 
.43 
.37 

218 
230 
228 
116 
226 

.42 

.42 

.42 

.28' 

.28 

.31 
.24 
.18 
.43 
.37 
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Table  3.18  (continued) 


Text 

H 

Prop. of 
Experts 

Prop. of 
All 

Text 

Prop. of   Prop. of 
Experts  All 

Text 

If 

Prop. of 
Experts ' 

Prop. of 
All 

TEXT  #111 

-TEXT  iS'  115 

TEXT  #219' 

219 

.71 

.37 

217 

LI/ 

1  00 

69 

107 

•57 

103 

.57 

.56 

113 

71 

770 

■  D  / 

226 

.42 

.37 

109 

42 

50 

229 
c  c  7 

.57 

.37 

109 

.42 

.24 

224 

28 

37 

226 

.42 

.56 

227 

.28 

.37 

221 

.42 

.56 

TEXT  if  116 

116 

.42 

.43 

TEXT  #  112 

1  1  n 
1  10 

.42 

.31 

107 
220 

.57 
.57 

.43 
.37 

106 

.42 

.31 

104 

.71 

.69  ' 

IU3 

.42 

.31 

101 

.71 

.43 

219 

.42 

.43 

222 

.71 

.37 

110 

.28 

.43 

7 

TEXT  #  220 

102 

.57 

.56 

103 

.28 

.37 

228 

.42 

.43 

225 

.28 

.37 

107 

.57 

.56 

227 

OiOO 

.37 

226 

.14 

.43 

219 
116 

.57 
.57 

.43 
.37 

TEXT  #113 

TEXT  §  217 

229 
225 

.42 
0.00 

.50 
.43 

115 

.71 

.50 

115 

1 .00 

.69 

217 
108 

.71 
.42 

.43 
.31 

113 
■  109 

.71 
.42 

.43 
.37 

TEXT  #221 

224. 

.28 

.43 

218 

'    ■■  .14 

.37 

223 

.71 

.63 

110 

.57 

.37 

TEXT  §  114 

TEXT  if  218 

106 

.42 

.37 

219 

.42 

.31 

224 

.57 

.37 

226 

.71 

.43 

114 

.42 

.24 

227 

.57 

.24 

111 

.71 

.37 

105 

.42 

.24 

230 

.57 

.24 

109 

.57 

.43 

228 

.28 

.50  " 

108 

..42 

.63 

103 

.57 

.24 

225 

.28 

.37 

105 

.42 

.37 

227 

.42 

.24 

229 

.28 

.37 

229 

.42 

.31 

229 

.42 

.18 

226 

.42 

.24 

224 

.28 

.37 

221 

.42 

.24 

217 

.14 

.37 

109 

.28 

.37 
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Table  3.18  (continued) 


Text 

Prop. of 

Prop. of 

Text 

Prop. of   Prop. of 

Text 

Prop. of 

Prop. of 

if 

Experts 

All 

Experts  All 

Experts 

All 

•  TEXT  #  111 

1 

TEXT  #  226 

TEXT  (If  229 

107 

.57 

.56  i 

103 

.85  .63 

CCXi 

71 
.  /  1 

.  J/ 

219 

.57 

.43 

218 

.71  .43 

ID  J 

-  .  D/ 

.  H  J 

116 

.57 

.37 

229 

.71  .37 

c  ly 

K7 

.  J/ 

229 

.42 

.50 

219 

.42  .56 

9  9A 
CC\J 

/I  9 

•  DU 

225 

0.00 

.43 

230 

.42  .37 

in 

Al 

111 

.42       .37  . 

114 

Al 

.31 

109 

.42  .24 

230 

-  .42 

.24 

TEXT  #  2Z3 

.18 

114 

.42  .24 

218 

.42 

221 

.71 

.63 

110 

.28  .37 

221 

.28 

.37 

.37 

228 

.227 

.24  .43 

109 

.28 

.57 

104 

.42 

.43 

116 

.14  .43 

108 

.14 

101 

.42 

.43 

224 

,      .14  .37 

110 

.42 

.37 

TEXT  #  230 

102 

.28 

.37 

TEXT  #  227 

  — 

105 

.57 

.37 

1  Lai  f 

226 

.57  .43 

114 

.57 

.24 

.37 

108 

.57  .31 

226 

.42 

225 

.71 

.56 

114 

.57  .24 

110 

.42 

.24 

114 

.57 

.37 

103 

.42  .43 

224 

.42 

.24 

230 

.42 

.24 

42  31 

229 

.42 

.24 

113 

.28 

.43 

42  24 

115 

.28 

.  .37 

105 

.42  .18 

218 

.28 

.37 

11 1 

28  37 

226 

.14 

.37 

TEXT  #  228 

TEXT  ^ 

(225 

104 

.71  .63 

102 

.57  .56 

224 

.71 

.56 

223 

. 57       . 56 

106 

.42 

.37 

222 

.57       .43  y 

116 

.28 

.37 

M12 

.42  .43 

221 

.28 

.37 

,  101 

.42  .43 

220 

0.00 

.43 

221 
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Finally,  two  major  groupings  emerged,  one  composed  of  Texts  #101, 
102,  104,  112,  222,  and  (possibly)  228,  ind  the  other  composed  of 
Texts  #115,  217,  and  113.    The  first  grouping  Involved  texts  that 
mainly  described  a  chronology  of  events.    The  second  Involved 
compare/contrast  texts.    A  third,  more  weakly  associated  grouping. 
Involving  Texts  #103,  111,  218,  226,  and  possibly  229,  seemed  to  be 
giving  a~ description  of  concepts. 

Results  of  the  second  procedure.  In  which  the  participants  took 
each  text  and  rated  on  a  scale  from  1  (perfect  match)  to  6  (not  at  all 
similar)  how  similar  It  was  to  their  Ideal  representation  of  each  of 
four  text  types,  were  analyzed.    Means  and  standard  deviations  were 
calculated  for  the  experts  for  the  total  group  (experts  and  non- 
expert^) separately.    In  Table  309,  the  codes  next  to  each  text  should 
be  Interpreted  as  Indicating  points  along  the  continuum  from  "perfect 
match"  to  "not  similar  at  all."    "S"  represents  a  mean  rating  less 
than  or  equal  to  2.5  with  a  standard  deviation  less  than  or  equal  to 
1.00;  "s"  represents  a  mean  rating  between  2.5  and  3.5;  "n"  represents 
a  mean  rajting  between  3.5  and  5.0;  and  "N"  Is  used  for  ratings  greater 
than  or  equal  to  5.0  with  standard  deviations  less  than^^or  equal  to 
1.00. 

As  Indicated  In  Table  3.19,  some  texts  are  much  more  distinc- 
tive than  others.    Texts  #105  and  111,  for  example,  are  strongly 
identified  as  representing  descriptions  and  strongly  rated  as-  NOT 
fitting  Categories  3  and  4,  with  a  slightly  weaker  "no"  being  given 
to  Category  2.    Texts  #107,  219,  220,  and  223  are  rated  by  the  group 
as  a  whole  as  showing  a  weak  descriptive  structure  in  combination 
with  a  weak  second  category,  either  chronology  (3)  or  causal 
description  (4). 

Texts  #217  and  115,  the  two  identified  as  compare/contrast 
texts  as  a  result  of  the  first  procecure,  are  both  rated  as  showing 
a  strong  comparison  structure  together  with  a  less  strong  but  positive 
description  structure.    The  "chronology"  or  process  texts  identified 
by  procedure  1.  Texts  #101.  102,  104,  222,  yielded  strong  Category  3 
ratings  but  also  strong  Category  1  (description)  ratings. 
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Table  J.19 

Summary  of  Similarity  Ratings  of  Texts  to  Four  Major  Text  Patterns 
by  Mapping  Experts  and  by  All  Raters 


  I  r 

Experts 

All   •              .  ; 

TEXT 

-  1 

2 

3 

4 

1 

2 

3 

4 

101 

(S) 

(N) 

(S) 

n 

s 

(N)- 

(S) 

(N) 

102 

(S) 
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*  Received  a  mean  rating  of  1.00,  perfect  match, 

1=  Description;  2»  Comparison;  3»  Chronology;  4=  Causal  Description  « 
(S)  «  mean  rating^2.5  with  s .d.  i^l  .00,  very  similar;  s  =  mean  rat1ng>2.5 
but<3.5,  similar;  n  »  mean  rating  >  3.5  but<5,  not  similar;  (N)  =  mean 
rat1ngi»5  with  s.d.^l.OO,  not  at  all,  similar. 


Discussion 

Results  were  in  line  with  our  original  prediction  that  some 
texts  would  show  clear,  simple  patterns'of  ideas  while  others  would 
be  hybrids  and/or  unclear  combinations  of  many  structural  relation- 
ships.   Thus,  the  concept  of  text 'types  might  best  be  viewed  as 
"text-typedness",  replacing   a  categorical  system  with  a  continuum. 
^  It  remains  to  be  established  whether  learners  would  be  affected 

significantly  by  degree  of  clarity  of  text  structure.    It  is  our  plan 
to  take  the  recall  data  from  the  high  school  students  (Section  III. 3) 
to  test  the  hypothesis  that  learners  find  it  easier  to  learn  from 
texts  that  have  clear,  simple  patterns. 
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Text  Analytic  Procedures :% 
Validations  and  Criticisms 
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'    The  use  of  text  analysis  procedures  (see  Tierney and  Mosenthal ,  1982 
for  a  description  of  different  prqcedOres)  has  been  integral  to  the  pursuit  of 
several  of  the  goals  associated  with  'our  project.    In  using  different  procedures 
we  have  tried  to  maintain  a  critical  eye  toward  what  might  be  uses  and  misuses 
of  any  procedure  as  well  as  val idation  of  any  method  enlisted.    Although  we  view 
text  analysis  procedures  as  providing  the  means  for  systematic  examinations 
of  characteristics  of  text  and  their  differential  influence  upon  comprehension, 
we  are  also  aware  that  any  one  procedure  does  not  afford  a  descriptioii  of 
every  text  characteristic,  across  every  text,  across  every  reading  situation. 
The  products  and  categories  that  flow  from  different  methods  of  text  analysis 
must  be  evaluated  with  a  clear  idea  of  what;  is  being  measured,  the  context 
within  which  things  are  being  measured,  the  reliability  with  which  features 
can  be  discerned,  and  those  aspects  of  text  eluding  analysis. 

Throughout  the  project,  the  review,  development,  use,  validation  and 
recogrnition  of  the  power  and  1  imitations  of  different  text  analysis  procedures 
prompted  a  number  of  papelrs.    For  this  report,  we  include  one  that  is  related  , 
directly  to  the  project  and  two  that  are  more  general  reflections  of  how  we 
have  come  to  view  text  analysis.    It  should  be  ndted  that  these  last  two 
papers  have  been  published  or  submitted  for  publication  elsewhere  under  the 
authorships  indicated. 
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PART  I:    THE  PSYCHOLOGICAL  REALITY  OF  THE  CONCEPT  OF  EMBEDDEDNESS 

Diane  L.  Schallert,  Julita  Hernandez,  Laura  Zendyas,  Claire  Laffey* 
Patricia  E.  Palmer 

On6  common  characteristic  of  techniques  of  text  desciription  is  that  they 


This  is  true  of  formal 
&78;  Turner  and  Greerve, 


yield  a  measure  of  the  relative  importance  of  text  units, 
systems  such  as  Kintsqh's  (1974;  Kintsch   and  van  Dijk,  1 

1977)  and  Meyer's  (1975),  as  well  as  more  informal  ratingi  that  directly  assess 
the  importance  of  units  (e.g.,  Pichert  and  Anderson,  1977,  Johnson,  1970). 
There  are  two  reasons  why  researchers  interested  in  how  readers  process  text 
materials  have  considered  importance  as  a  factor  in  text  research.    The  first 
is  related  to  an  obvious  feature  of  subjects'  memory  for  (extended  discourse, 
its  selective  imperfection.    When  dealing  with  text,  readers  demonstrate  a  ten- 
dency to  focus  on  some  6f  the  ideas  presented  bj|  an  author  and  to  ignore  others. 
Faced  with  this  phenomenon,  researchers  have  been  reluctant  to  treat  as  equivalent 
the  performance  of  subjects  who  select  a  few  ideas  that  are  critical  and 
essential  wiith  that  of  subjects' who  seem  to  be  reporting  ideas  as  if  randomly 
selecting  from  a  list  of  isolated  items.    In  response  to  this  need,  text 


description  systems  have  been  developed  that  identify /thos 


analysts  or  riaters  deem  as  most  important  in  text,  ^ne  ubiquitous  finding  has 
been  that  readers  are  more  likely  to  remember,  and  to  include  in  their  summaries 
information  Identified  independently  as  being  more  important. 

is  that  it  is  very 


e  ideas  that  text 


The  secolid  reason  why  importance  has  been  of  interest 
much  related  to,  and  is  in  fact  the  psychologist's  equival 


and  curriculum  materials  call  the  "main  po 


int"  Jf 


ent  of,  what  teachers 


text  materials.  Educators 


identify  the  main 


often  express  a  concern  that  students  will  not  be  able  to 
idea  or  intent  of  an  author's  message. 

Thus,  text  description  systems  generally  have  some  method  for  identifying 
the  relative  importance  of  ideas  presented  in  text.    Our  method  of  text 
description,  relational  mapping  (described  in  Section  III),  yields  a  measure 
which  we  see  as  closely  related  to\he  concept  of  text  importance  addressed  in 


the  existing  literature.    Our  purpose  in  this  study  was  to 
ship  between  the  psychological  variable  of  importance  and 
variable  of  embeddedness  (see  Section  III). 
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he  formally  derived 


Method 


Partitipants  were  100  undergraduate  students  Vrom  an  introductory  Psychology 
course  who  participated  in  fulfillment  of  a  course  requirement. 

Materials 

We  chose  20  texts  (10  History  and  1  0  Biology)  from  the  pool  of  texts  in 
^our  original  sample.    Half  of  tht  History  and  half  of  the  Biology  texts  were 
selected  because  they  had  been  rated  as  having  a  relatively  clear,  unidimenSional 
pattern.    We  chlled'these  the  "structured  texts'*  (refer  to  Appendix  D  for 
Texts  #103,  105,  110,  111^  113,  217,  222,  225,  226  and  227).    Half  were  chosen  , 
because  they  represented  a  less  clear  pattern  of  ideas  and  relationships 
(Texts  #104,  106,  107,  114»  115,  218,  219r  220,  223  and  229).    These  judgments 
of  clarity  of  text  pattejf^n  came  as  a  result  of  the  procedure  described  in  Part  5  , 
of  Section  III. 

For  each  text,j  the  list  of  relationship  propositions  was  examined  to  identify 
the  pool  of  items  that  represented  propositions  at  a  high  level  in  the  text 
(embeddedness  ratings  of  INn^)  and  propositions  at  a  Tow  level  (embeddedn^ss  ^ 
ratings  of  3  or  more  steps  frcmi  the  main  topic).    Within  each  of  these 
categories,  pro p6?TTtonstKat  were  explicitly  rendered  in  the  text  (expl icitness 
ratings  of  1-1-1  across  the  proposition)  and  propositions  that  had  any  of  their 
parts  rated  irlipltgH  were  identified.    We  then  attempted  to  find  three  of  each 
of  the  four  possible  types  of  propositions  (high/explicit,  high/imp3 icit ,  low/ 
explicit  and  low/implicit).    Where  there^were  more  than  three  propositions 
in  a  category,  three  were  randomly  chosen.    In  three  of  our  texts,  one  category 
could  not  be  filled  because  there  were  not  enough  propositions  of  the  type 
heeded.    Thus,  text  #^07  has  only  two  propositions  that  are  high/impl icit; 
Text  #110  has  only  one  low/implicit  propositions    and  Text  #111  has  only  two^ 
low/implicit  propositions. 

The  identified  propositions  of  each  category  were  then  rewritten  as  normal 

f    >  ■ 

English  sentences  (see  Appendix  I  for  the  complete  set  of  sentences  presented 
in  their  rating  format).    The  sentences  were  lifted  on  a  rating  sheet  each 
following  for  a  six-point  rating  scale  with        identified  as  "extremely  un- 
important" and  "6"  identified  as  "extremely  important."  ^ 


The  20  texts  and  their  rating  sentences  were  then  divided  into  five 
groupings  of  four  texts  each,  comprised  of  one  History  structured,  one  Biology 
structured,  one  History  unstructured  and  one  Biology  unstructured  text.  Within 
each  grouping,  the  order  of  texts  was  counterbalanced. 

Procedure 

The  rating  task  was  administered  to  small  groups  of  subjects  in  several 

sessions  of  one  hour  each.    The  texts  and  rating  sheets  were  compiled  into 

single. booklets  and  randomly  distributed  to  the  students  as  they  arrived  for  the 

experiment.    On  the  first  page  of  the  booklet,  the  foUowi'^g  instructions 

appeared :  / 

As  you 'are  well  aware,  you  never  learn 
everything  presented  in  a  unit  from  one  of  your 
textbooks.    Some  information  seems  to  be  more  important 
than  other  information  and  receives  more  of  your 
attention,  time  and  effort.    Your  task  for  this  study 
generally  involves  rating  the  importance  of  ideas 
derived  from  four  excerpts  taken  from  a  high  school 
level  textbook.    In  a  very  real  sense,  we  are  calling 
upon  your  expertise  as  a  learner  arid  as  9  user  of  the 
English  language  to  help  us  identify  the  level  of 
importance  of  ideas  in  text. 

Specifically,  you  will  read  through  one  excerpt 
of  about  300  words.    You  will  turn  irmnediately  to  a  list 
of  sentences  we  have  written  (no  more  than  12)  to  ijd 
represent  some  of  the  ideas  in  the  passage.  Frequently, 
the  wording  of  the  rating  sentences  is  different  from 
the  wording  in  the  text.    Try  as  best  as  you  can  to  rate 
the  importance  of  the  Idea,  represented  in  each  sentence 
against  the  full  original  xext.    The  ratings  are  on  a 
6-poiht  scale,  with  "T'  used  to  indicate  an  extremely 
unimportant  idea  and  "^6"  used  for  an  extremely  important 
idea.    You  may  refer  back  to  the  original  text  as  often 
as  you  wish.  , 

Once  you  have  finished  the  first  text  and  once 
you  have  taken  a  short  break  (1  to  3  minutes),  please 
-    go  on  to  the  second  excerpt  and  follow  exactly  the  same 
procedure:    read  through  the  whole  passage,  then  read 
each  sentence  and  rate  how  important  the  idea  represented 
in  the  sentence  is  in  terms  of  the  whole  passage.  Repeat 
this  same  procedure  for  a  third  and  fourth  text.  The 
order  of  passages  is  different  for  each  person.  Therefore, 
work  at  your  own  pace  and  with  care  until  you  have  finished 
rating  al 1  the  text. 

You  may  ask  questions  now  or  al  any  point  during 
the  task. 
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The  students  read  the  Instructions,  turned  to  the  first  text,  read  It 
through,  and  then  completed  the  rating  of  the  12  sentences.    They  then  saw  Instruc- 
Tlons  that~asked  themTo  TesF  for~a~  few  before  going  on  to  the  second  text. 

They  proceeded  through  all  four  texts  in  the  same  manner  at  their  own  pace. 

Results 

:0' ;     Subjects'  ratings  of  Importance  were  analyzed  in  a  5  (Lists)  X  2 
(structurfed/unstructured  text)  X  2  "(Science/History  text)  X  2  (High/Low  Ideas) 
X  2  (Explicit/Implicit  Ideas)  repeated  measures  design.    AN0VA8,  a  modified 
version  of  the  UCLA  Blomed  Program  BMD08V  (Marston,  1978)  was  used  for  the 
analysis. 

The  main  effects  of  Lists  and  of  Topic  (History  vs.  Biology.)  were  not 
significant.    There  was  a  significant  main  effect  for  structured  vs.  unstructured 
text,  F  (1  ,95)  =  5.82,  £<.05.    Idea  units,  as  a  group,  for  structured  texts 
were  rated  as  significantly  less  important  (x  =  3.96)  than  idea  units,  as  a 
group,  for  unstructured  texts  (x  =  4.06).    There  was  also  a  significant  main 
effect  for  level  of  idea  in  a  text,  F  (1,95)  =  70.67,  £<  .001.    Ideas  high, 
i.n  the  text  structure  were  rated  as  significantly  more  important  (x  ?  4.19) 
than  ideas  low  in  the  text  structure  (x  =  3.84).    Finally,- the  main  effect  of 
explicitness  was  significant,  F  (1,95)  =  50.55,  £<.001.    Ideas  stated 
explicitly  In  the  text  (x  =  3.90)  were  rated  significantly  less  important  ' 
than  Ideas  stated  implicitly  In  the  text  (x  =  4.12). 

A  number  of  significant  two-way,  three-way  and  four-way  interactions 

were  subsumed  by  a  significant  five-way  interaction,  F  (4,95)  =  9.72,  £<  .001).^ 

Thus,  while  generally  it  was  true  that  high-level,  explicit  Ideas  derived 

from  unstructured  texts  were  rated' as 'more  important  than.  1ow-l  evel.j  Impl  icit 

ones  derived  from  structured  texts,  the  significant  five-way . interaction 

Indicated  that  the  pattern  of  Importance  ratings  for  each  text  was  unique. 

Since  we  were  most  interested  in  testing  whether  high-level  ideas  received 

2 

higher  Importance  ratings  than  low-level  ideas, -we  undertook    x  analyses 
to  further  explicate  the  five-way  interaction.    For  each  text  categorized  by 
whether  it  was  a  History  or  Biology  text  and  by  whether  It  was  structured 
or  not,  we  examined  the  relative  order  of  means  for  high-level  and  low-level 
ideas  within  each  of  the  expl  Iclt/lmpl kit  Categories.    We  found  that 
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for  History  texts,  the  pattern  supporting  our  hypothesis  (high^low)  was 
confirmed  in  16  of  20  pairs  (10  texts  with  ideas  divided  into  explicit  and 

implicit  categories).    One  of  the  exceptions  (low>high)  occurred  in  the 

'  2 
explicit  category  and  three  occurred  jn  the  implicit  category.    The  x  . 

supporting  our  prediction  was  significant ♦  £<.01.    For  the  Biology  texts, 

again  16  of  the  20  contrasts  supported  the  hypothesis .^rtlffhe  four  exceptions 

2 

were  distributed  evenly  between  explicit  and  implicit  categories,  x   ^  7.2, 
£<.01,  and  all  occurred  in  structured  texts. 

Discussion 

Results  overwhelmingly  confirmed  our  prediction  that  relationship  proposi- 
tions identified  in  mapping  as  closely  t.ied  to  the  main. topic  of  a  text 
would  be  rated  as  more  important  than  ideas  low  (more  embedded)  in  the  text 
structure.    This  finding  was  based  upon  asking  a  relatively  large  number 
.  of  raters  (20  per  text)  to  look  a?^  relatively  large  number  of  texts  (again 
20)  representing  different  topics,  disciplines  and  rated  degree  of  clarity 

structure.    Based  upon  this  finding  and  results  i)f  the  learning  study 
described  earlier  in  which  high  level  ideas  were  more  likely  to  be  remembered, 
we  feel  confident  that  relational  mapping  provides  a  psychologically  relevant 
representation  of  what  a  text  author  intends  a"  reader  to  learn  from  the  text. 
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PART  2:    A  CRITICAL  LOOK  AT  MACRO-ANALYSES'  OF  TEXT 
Robert  J.  Tlerney  and  James  Mosenthal 

The  purpose  of  this  paper  1s  to  consider  the  use  of  certain 
text  analysis  systems  as  a  means  for  providing  formal  representa- 
tions of  text.    Specifically,  we  look  at  Meyer's  system  for 
formally  describing  expository  texts  (Meyer,  1975),  and  at  Thorn- 
dyke's  grammar  hr  formally  describing  simple  stories  (Thorndyke, 
1977).    These  two  systems  are  discussed  in  relation  to  van  Dijk's 
notions  on  macro-structures  and  macro-operators  and  their  Incorpor- 
ation In  a  theory  of  text  grammar— a  theory  which  means  to  allow 
for  the  formal  representation  of  any  text.    It  Is  our  argument 
that  text  analysis  Is  misapplied  when  the  particular  system  used 
claims  to  fonmally  represent  that  which  Is  structurally  Inherent 
to  a  text. 

The  concept  of  a  formal  representation  of  text  Implies  a 
representation  that  Is  rule  governed.    Such  a  representation  means 
to  formally  describe  something  Inherent  In  the  text.    This  attempt 
encourages  a  use  and  an  approach  to  text  structure  that  treats  a 
text  as  If  It  were  an  absolute.    Van  Dtjk's  notion  of  a  text 
graimiar  theorizes  the  legitimacy  of  formally  represented  texts 
while  the  systems  described  by  Meyer  and  Thorndyke  assume  the 
legitimacy  of  such  representation.    Unfortunately,  In  reading 
research  It  Is  a  deceptively  satisfying  notion  to  hypothesize  a 
formal  description  of,  or  template  for,  a  text  which  can  be  used 
for  comparing  and  evaluating  recalls.    The  fact  Is,  there  are 
problems  with  the  idea  of  a  formal  representation  of  text— at 
least  In  so  far  as  macro-analyses  are  concerned. 

Consider  a  possible  formal  representation 'of  the 'plot 
structure  of  a  simple  story  proposed  by  Thorndyke.    According  to 
Thorndyke,  any  story  can  be >generated  formally  by  the  categories 
of  the  grammar  (setting,  theme,  plot,  resolution,  etc.)  and  the 
rules  (never  defined  explicitly)  for  generating  the  plot  structure 
However,  Thorndyke's  grammar  can  be  criticized  for  the  arbitrari- 
ness with  which  the  grammar's  rules  are  applied  to  a  story.. 
Essentially  arbitrary  decisions  are  made  concerning  the  assignment 


of  parts  of  a  story  to  the  categories  of  the  grammar— the 
decisions  are  not- grammatically  determined.    In  other^words,  the 
assignment  of  parts  of  a  story  to  a  category  of  the  grammar  is  as 
much  a  product  of  one's  world  knowledge  relative  to  stories  as  it 
1s  a  product  of  the  grammatical  description  of  a  story.    It  could 
be  argued  that  Thorndyke's  grammar  is  mean,t  only  to  describe  an 
internalized  grammar  for  stories.    However,  the  idealized 
description  of  this  grammar,  which  Thorndyke  does  mean  to  describe, 
still  has  none  of  the  formal  rigor  characteristic  of  the  concept 
of  a  grammar.    In  other  words,  ThorndykeJs  grammar  does  not 
describe  any  rules  or  operations.,  which  allow  or  determine  trans- 
formations in  the  grammatical  description  of  a  story. 
Consider  the  following  text: 

The  Garbage  Collectors  of  the  Sea  . 

The  garbage  collectors  of  the  sea  are  the  decomposers. 
Day  and  night,  ocean  plants  and  animals  that  die,  and 
the  body  wastes  of  living  animals,  slowly  drift  down  to 
the  sea  floor.    There  is  a  steady  rain  of  such  material 
that  builds  up  on  the  sea  bottom.    This  is  especially 
true  on  the  continental  shelves,  where  life  is  rich. 
-It  is  less  true  in  the  desert  regions  of  the  deep  ocean. 

As  on  the  land,  different  kinds  of  bacteria  also 
live  in  the  sea.    They  attack  the  remains  of  dead  plants 
and  animal  tissue  and  break  it  down  into  nutrients. 
These  nutrients  are  then  taken  up  by  pi  ant. and  animal 
plankton  alike.    Among  such  nutrients  are  nitrate, 
phosphate,  manganese,  silica,  and  calcium. 

As  the  nutrients  are  released,  they  spread  around  in 
the  water.    But  they  tend  to  stay  near  the  bottomoUntil 
some  motion  of  the  water  stirs  them.    As  you  saw 
earlier,  during  those  seasons  when  the  water  is  churned 
up  and  mixed,  the  nutrients  are  brought  up  to  the 
surface/  They  may  also  be  brought  up  by  the  upwelling  \^ 
action  of  deep  currents.*  This  is  especially  so  along 
the  west  coasts  of  Africa,  South  America,  and  North 
America.    Wherever  there  are  regions  of  upwelling  of 
nutrients,  there  are  rich  "fields"  of  plant  plankton, 
usually  during  all  seasons  of  the  year. 

So  nutrients  are  kept  circulating  endlessly  in  the 
oceans,  and  are  used  over  and  over  again  by  plant 
plankton  and  whales  alike.    When  a  plant  or  animal 
breaks  down  the  sugar-fuel  it  needs  for  growth,  the 
energy  stored  by  the  sugar  is  used.    Some  of  it  goes 
into  building  new  body  parts  and  some  of  it  is  lost 
as  heat.    This  is  not  true  of  nutrients. 


Nutrients  are  not  "used  up"  in  that  way.    For  a 
while,  oxygen,  carbon,  calcium,  and  other  nutrients 
that  a  plant  or  animal  takes  in  become  part  of  the   -  : 
plant  or  animal.    But  when  the  animal  or  plant  dies 
and  when  it  gives  off  body  wastes,  the  nutrients 
are  returned  to  the  environment  and  can  J3e  used 
again  and  agajn.    (Taken  from  Ginn  Science  Program, 
1975.  Intermediate  Level  C,  p.  395-396.) 

Applying  Meyer's  content  structure  analysis  sys'tem  yields 

Figure  4.    In  structure,  the  underlined  terms  written  in  lower 

case  letters  represent  rhetorical  predicates  describing  the 

relationship  between  parts  of  a  text.    Such  a  rhetorical  predicate 

as  covariance  antecedent/consequent  describes  a  relationship  of 

causality  or  allowability  between  parts  of  the  text.    Left  most 

entries  describe  superordinate  propositions  of  the  text  (macno- 

propositijons).  Overall,  the  content  structure  means  to  present  a 

formal  representation  of  that  structuring  of  ideas  which  is 

Inherent  to  the  text  and  which  determines  comprehension  of  the 

text. 

'  However,  the  arbitrariness  of  the  determination  of  rhetorical 
predicates  and  the  actual  propositions  is  evident  when  discussing 
entries  8-10.    These  entries,  dealing  with  the  topic  of  nutrients, 
should  appear  between  entries  6  and  7— subordinate  to  those 
entries.    But  it  is  apparent  from  reading  the  text  that  entry  8 
should  appear  as  a  left  most  entry  since  the  topic  of  nutrients 
dominates  most  of  the  passage.    This  is  the  case  although  the  text 
itself  does  not  initially  prepare  for  this  dominance  and  does  not- 
allow  for  any  formal  'vertical'  tie  between  the  left  most  entries 
1  and  8. 

This  problem  of  arbitrariness  is  not  just  a  characteristic 
of  lieyer's  and  Thorndyke's  text  analysis  systems  but  it  is  also 
characteristic  of  van  Dijk's  more  formal  approach.    In  his  article, 
"Text  grammar  and  text  logic"  (1973),^ van  Dijk  presents  a  text  ' 
logic  describing  the  micro-structure  of  a  text.   More  recently 
(van  Dijk,  1977a,  1977b),  he  implies  that  with  macro-operators 
one  can  provide  a  formal  proof  for  a  macro-structure  of  a  text. 
He  describes  four  macro-operations:    construction,  generalization. 
Integration,  ancl^^jjeletion.   The  extent  to  which  these  macro- 


operations    are  ^formal  operations  Is  evl'dent  from  van  Dijk's 
definition  of  the  four  operations.    Consider  the  definition  of  the 
Integration  operation: 

Given  a  sequence  of  propositions  Z  =  (£i,  £2»  .  .  £^)» 
n^  >^  2,  If  there  Is  a  proposition  £^ ,  such  that  for  each 
proposition  p^,  ^^^^      either  a  normal  condition,  a 

normal  component,  or  a  normal  consequence  of  V(£.^).  then 
we  may  substitute  £^  for  Z.    (van  Dijk,  1977a,  iJ) 

In  this  definition  V^(£^)  denotes  t;he  fact  or  truth  of  relative 
to  the  'world'  described  by  the  text.    In  practice,  elements  of 
the  formal  description  of  the  micro-structure  of  a  text  are 
operated  on  by  the  Integration  operator  (or  one  of  the  other 
operators).    Through. progressive  applications  of  the  operators 
progressively  more  general  levels  of  a  macro-structure  are  developed 

.  Consider  the  informal  application  of  van  Dijk's  text  logic 
to  the  first  paragraph  of  'Garbage  Collector?  of  the  Sea.'  The 
micro-structure  of  this  text  might  consist  of  the  following  list 
of  micro-propositions: 

1.  (there  are)  garbage  collectors  of  the  sea  (from  the  title) 

2.  the  garbage  collectors  of  the  sea  are  the  decomposers 

3.  day  and  night,  ocean  plants  and  animals  die 

4.  and  slowly  drift  down  to  the  sea  floor 

5.  day  and  night  the  body  wastes  of  living  animals  slowly 
'  drift  to  the  sea  floor 

6.  there  is  a  steady  rain  of  such  material 

7.  that  builds  up  on  the  sea  bottom 

8.  this  is  especially  true  on  the  continental  shelves 

9.  where  life  is  rich 

10.    it  is  less  true  in  the  desert  regions  of  the  deep  ocean 
Such  a  listJ^ould  be  given  for  the  entire  text.    If  the  macro- 
operators  construction,  generalization,  integration,  and  deletion 
are  Informally  applied  to  the  list  of  micro-propositions  the 
following  diagram  of  a  macro-structure  for  the  text  might  develop: 
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AND  BODY  WASTES  DRIFT  TO  THE  SEA  FLOOR 

specific 

lOTlJrSUCH  MATERIAL  BUILDS  UP  ON  THE  SEA  BOTTOM 


covariance  antecedent  - 

BACTERIA ATtACK THE  REMAINS  OF  DEAD  PLANT  AND  ANIMAL  TISSUE 


covariance  consequent ^  covariance  auatecedent 

BftEAk  bOWN  rImains  Into  Nutrients-'^ 


covariance  consequent 

NUTRIENTS  Aft£  THEN  TAKEN  UP  BY  PLANT  AND  ANIMAL 
PLANKTON 


8    TlNUYftlENtS  ARE  KEPT  CIRCULATING  ENDLESSLY  AND  ARE  USED  OVER  AND 
lOVER  AGAIN 

analogy,  adversative 

THE  ENEl^fiY  STORED  6Y  THE  (BREAKDOWN  OF)  SUGAR  IS  USED 
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w8eN  the  ANIMAL  OR  PLANT  DIES  AND  WHEN  IT  GIVES  OFF  BODY 
WASTES.  THE  NUTRIENTS  ARE  RETURNED  TO  THE  ENVIRONMENT  AND 
CAN  BE  USED  AGAIN  AND  AGAIN 
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MP! 

'  MP2 

■    I  ^  , 

MP5.1 

I 

MP4 — MP5 — MP6 
I 

W3  - 

where  the  macro-propositions  are: 

MP!    there  are  garbage  collectors  of  the  sea 

MP2    the  garbage  collectors  of  the  sea  are  the  decomposers 

MP3   the  remains  of  ocean  plants  and  animals,  and  the  body 

wastes  of  living  animals  b,u11d  up  on  the  sea  floor 
MP4  .organic  material  builds  up  on  the  sea  flgpr 
MP5.1  the  decomposers  are  the  bacteria 
MP6    the  nutrients  are  used  over  and  over  again 
It  Is  apparent  that  this  macro-structure  represents  a  suinnary 
of  the  text.    The  point  of  setting  up°  this  macro-structure  Is  to 
indicate  that,  even  with  a  formally  ^letermlned  micro-structure 
and  the  formal  application  of  macro-opeVs^tors^,  the  arbitrariness 
of  the  decisions  necessary  for  the  generation  of  certain  macro- 
propositions  such  aflW^PS.O  remains  evident.    For  example,  no 
Informal  use  of  macfw^operators  (assumed  or  stated)  in  a  macro- 
analysis  of  a  text,  can  absolutely  determine  such  a  macro-proposi- 
tion as  MP5.1.    Yet,  the  Importance  of  MP5.1  is  apparent  in  the 
macro-structure  diagram.    Without  it,  no  tie  is  made  batij/een  ^ 
macro-propositions  1  and  2,  and  the  macro-proposi tions  oSs^ribing 
the  cycling  of  nutrients.    It  is  a  problem  in  the  macro-«fftalys1s 
of  the  text  that  such  a  strong  Inference  must  be  made  arbitrarily^ 
from  world  knowledge  in  order  to  relate  explicitly  all  aspects  of 
the  text^n  the  macro-analysis. 

Despite'the  shortcomings  of  van  Dijk's  macro-analysis  the' 
general  notion  of  a  text  logic  as  he  proposes  would  seem  legitimate, 
for  the  attempt  to  set  up  such  a  logic  is  a  necessary  pre-requisite 
to  deriving  a  resultant  macro-structure  depicting  a  formaf 
representation  of  text.    Without  macro-operators  and  a  formal  micro- 
structure,  the  determination  of  a  macro-structure  (that  which  is 
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structurally  Inherent  to  a  text)  would  seem  an  Impossibility.  In 
other  words  without  both  macro-operators  and  a  micro-structure  the 
claim  that  the  macro-structure  of  a  text  Is  formal  and  rule 
governed  seems  theoretically  misconceived.    Unfortunately,  neither 
Meyer  nor  Thorndyke  describe  formally  determined  micro-structures 
or  a  formal  procedure  for  the  macro-analysis  of  a  text.  .  Ar)d,  In 
Its  present  form,  van  Dijk's  text  logic  and  macro-operators  seem 
Inadequate  (see  Klefer,  1977,  &  Morgan  &  Sellner,  In  press,  for 
additional  criticism). 

With  these  limitations  of  macro-analyses  In  mind.  It  Is 
appropriate.  In  the  field  of  reading. research, , that  the  goals  of 
text-analysis  be  re-evaluated— especially  such  goals  as  formulated 
at  the  National  Institute  of  Education's  Conference  on  Studies  In 
Reading,  1975.    In  the  report  of  that  conference.  It  was  stated 
that 

a,  necessary  pre-requ1s1te  to  research  on  the  structural 
properties  of  text  and  their  Interaction  with  the 
processing  characteristics  of  the  reader  Is  the  develop- 
ment of  a  linguistic  model  of  discourse  structure. 
(NIE  Conference  on  Studies  In  Reading,  1975) 
If  It  Is  not  an  Impossible  attempt.  It  Is  a^t  least,  at  this  time,  ^ 
an  Inadequate  analogy  to  suppose  that  the  structural  properties. of 
texts  can  be  parsed  as  If  they  have  the  structural  Integrity  of  a 
sentence.    From  a  more  practical  perspective.  It  is  not  that 
macro-analyses  of  texts  are  totally  Inappropriate  In  experimental 
research--1t  Is  that  they  are  appropriate  only  as  one  possible 
tool  reflecting,  not  defining,  processes  of  text  comprehens1X)n. 
In  the  case  of  macro-operations.  It  Is  best.' when  dealing  with 
text,  to  use  the  concept  of  macro-operators  as  descriptors  for 
cognitive  processes^representlng  general  principles  of  perception, 
reasoning,  and  world  Iwewledge.    Researchers  Intent  on  using 
macro-analyses ^aJ\text  should  be  aware  of  the  theoretical  fallibility 
of  their  system  for  analyzing  texts.   Macro-analyses  of  text  do 
not,  as  the  systems  of  Meyer  and  Thorndyke  suggest,  describe 
Inherent,  absolute  structural  properties*  of  text.    At  the  very 
least,  researchers  should  provide  th'feir  aud^ce?  with  the  actual 


macro'-analyses  used  and  s^iould  cdirment  on  the  general UabiWty  of 
"their  macro-models  as  well  as  comment  on  the  extent  to  which  they 
are  arbitrar1?^y^er1ved. 
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PART  3:    BETWEEN  THE  HORNS  OF  AN  APPLIED  DILEMMA: 

COHESION    ANALYSIS  IN  READING  COMPREHENSION  RESEARCH 
James  Mosenthal  -       Robert  J.  Tierney 

In  the  present  paper,  we  discuss  Haili day  and  Hasan's  (1976) 
concept  of  cohesion   and  its  . problematic  use  in  reading  compre- 
hension research/  While  this  research  has  been  exploratory  and 
its  conclusions  tentative,  there  is  a  certain  amount  of  optimism 
about  the  relevance  of  the  concept  of  cohesion    to  the  applied  '  ./. 
concerns  of  reading  educators.'  However, ^such  optimism  often  leads 
the  reading  educator  between  the  horns  of  a  dilemma.^  The  dilemma 
is  one  characterized  by  the  opposition  between  (1)  the  instructionar 
usefulness  of  absolute  statements  about  text  difficulty  and  (2)  the 
instructional Ty  unmanageable  nptions  of  difficulty  defined  relative 
to  the  individual  readef*.    It  is  as  if  one  horn  of  the  dilemma 
held  the  reader  and  the  other  tield  t;he  text.    From  the  perspective 
of  the  reading  educator  and  teacher,  the  temptation ^s  to  steer 
toward  the  horn  of  the  text  and  the  apparent  security  of  measur- 
able entities  within  a  text.    For  the  reading  educator  who  wants 
to.be  able  to  tell  teachers  how  to  asses'S  effectively  the  case 
with  which  a  student  of  a  certain  ability  will  be  able  to  read  a 
given  passage,  the  ability  to  quantify  text  variables  is^  seductive. 
Unfortunately,  the  dilerrena  emerges  when  reading  educators  examine 
such  quantification  against  the  behavior  and  responses  of 
individual  readers. 

Though  the  dilemma  is  not  new  to^  researchers  and  educators, 
it  is  still  unresolved.    In  Halliday  and  Hasan's  (1976)  cohesion 
concept  the  dilemma  is  discovered  anew,  for  the  temptation  is  to 
view  the  cohesion   concept  as  a  given,  quantifiable  text  variable 
defining  a  level  of  coherence  difficulty  for  texts. 

It  is  with  this  concern  for  the  applied  dilemma  that  we 
wish  to  explore  the  use  of  cohesive   analysis  in  reading 
comprehension  research.    In  the  paper  we  will  present  Haljiday 
and  Hansan's  cohesive   concept,  explore  its  problematic  jstatus 
as  a  theory  of  textual  coherence,  and  discuss  reading  comprehension 
based  research  which  has  used  cohensive  analysis.    For  those 
among  the  readers  of  this  artic1e^wha>are  interested  in  text- 

,fi5  137 


J 


analytic  procedures  other  than  cohesi{re   analysis,  the  problems  which 
will  be  represented  appear  generalizable.    In  this  paper,  we  recormend 
that  researchers  and  educators  be  wary  of  the  dilemma  tiat  grows 
from  using  text-analytic  methods  as  a  way  of  modeling  comprehension 
rather  than  as  a  descriptive  tool  for  use  in  reading  comprehension 
research.  ^ 

With  due  regard  to  Hall i day  and  Hasan's-expositiot  of  the 
cohesive   concept,  they  are  not  responsible  fOr  the  dilismma  we 
depict.    In  their  exposition,  cthesive  analyses  of  text  are  used 
descriptively.    The  cohesive   concept  is  not  set  forth  as  a  model 
of  textual  coherence  relevant  to  comprehension  in  reading 
acquisition  or  in  the  development  of  reading  fluency.    However,  the 
cohesive   concept,  as  we  relate,,  is  not  without  its  theoretical 
drawbacks.    It  is  possible  that  our  applied  dilemma,  when  dealing 
with  the  cohesive   concept,  finds  it  roots  in  these  thejDretical 
seams.  ^ 
the  Cohesion  Concept 

Cohesive    is  described  by  Hal li day  and  Hasan  (1976)  as  a 
text-bound,  linguistic  phenomenon.    For  example,  in  the  sentence 
Wash  and  core  six  cooking  apples.    Put  them 
into  a  fireproof  dish  (Halliday  and  Hasan,  1976,  2)  ^ 
them  is  a  cohesive  item  presupposing  the  phrase  six  cooking  apples. 
Together,  the  presupposing  and  presupposed  items  define  a 
cohesive  tie. 

There  are  several  types  of  such  ties.    There  are  reference 
ties  where  pronouns,  usually  in  one^sentence,  presuppose  some 
'noun  or  noun  phrase  In  another  sentence  as  in  th^  example  above. 
There  are  substitution  ties  where  words  such  as  one  substitute 
for  and  thereby  presuppose  previous  reference  to  a  noun  or  noun 
phrase:  '  *  . 

Two  books  lay  on  the  table.    John  picked  up 
the  larger  one.  . 
There  are  ties  of  ellipsis  where  the  absence  of  a  presupposing 
item  assumes  a  presupposed  item  or  phrase: 

Have  you  seen  the  moVie?    Yes,  I  have. 
(seen  the  mdvie  is  .presupposed  in  the  second  sentence) 
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4.16, 


138 


There  are  ties  of  conjunction  where  connectives  are  used  to  relate 
sentences: 

^       The  English  Bill  of  Rights  is  an  Important 
document  in  English  history-    However,  it  is 
second  in  importance  to  the  Magna  Carta, 
Finally,  there  are  lexical  ties  where  items  are  tied  either  by 
reiteration:  ' 

The  paper  is  on  attribution  theory,  /Actually, 
the  paper  criticizes  attribution  theory, 
or  collocation,  where  items  have  the  semantic  potential  of  ^ 
appearing  together  in  a  text: 

We  had  miserable  weather  last  Saturday-  This 
weekend  isn*t  supposed  to  be  any  better. 
In  Halliday  and  Hasan  the  description  of  the  totality  pf  such  ties 
in  a  text  constitutes  the  text's   cohesion--the  extent  to  which  a 
text. is  internally  and  formally  coherent. 

Of  importance  in  this  regard  is  Halliday  and.Hasan'^ 
description  of  the  total  coherence  of  a  text: 

A  text  is  a  passage  of  discourse  which  is 
coherent  in  these  two  regards:    it  is  coherent 
with  respect  to  the  context  of  situation,  and 
therefore  consistent  in  register;  and  it  is 
coherent  with  respect  to  itself,  and  therefore 
cohesive.    Neither  of  these  two  conditions 
is  sufficient  without  the  other,  nor  does 
the  one  by  necessity  entail  the  other  .  ,  . 
the  hearer,  or  reader,  reacts  to  both  of 
these  things  lh  his  judgment  of  texture 
(Halliday  and  Hasan,  1976,  23). 
Elsewhere,  Halliday  (1973)  describes  the  grammar  of  a 
language  as  a  "system  of  available  options"  from  which  "the  speaker 
or  writer  selects"  optlonS""not  in  vacua,  but  in  the.  context  of 
speech  situations  (Halliday,  1973,  142)."   And  in  more  recent  work, 
Halliday  (1977)  speaking'specifically  of  referential  cohesion, 
states  that  instances  of  referential  cohesion  are  "interpretable 
only  when  we  know  who  'she'  is,  what  'this'  is'.and  'earlier'  than 
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'    what"  (Hall  1  day,  1977.,  188).    The  upshot  of  these  statements  is 
that  cohesion  is  thought  of  by  Hal li day,  when  looking  across  his 
work,  as  a  means  of  signalling  the  relatiinghip  between  a  cohesive 
item  and  a  concept  of  person  already  referred  to,  but  not  in  any 
way  as  a  means. of  creating  the  relationship.   That  is,  the 
cohesive  items  signal  that  a  relation^ip  is  to  be  inferred  but 
does  not  constitute  the  inference  in  the  mind  of  the  reader. 

However,  in  Cohesion  in  English,  this  point  of  view  is  not 
clearly  stated  and  leads  to  the  probl-ematic ,  text -bound  coherence 
producing  interpretation  of  the  cohesion  concept.    There  are  two 
fronts  to  the  problem:    (1)  the  unfocused    description  of  the 
function  of  cohesion  in  text;  and, (2)  its  theoretical  inadequacy. 
With  respect  to  (1),  consider  the  following  remarks  by  Halliday 
and  Hasan  concerning  cohesive  r'elations: 
,  •  The  concept  of  cohesion  is  set  up  to  account 

'for  relations  in  discourse  .  .  .  without  the 
implication  that  there  is  some  structural 
.    unit  that  is  above  the  sentence.  Cohesion 
refers  to  the  range  of  possibilities  that 
exist  for  linking  something  with  what  has 
gone  before.    Since  this  linking  is  achieved 
through  relations  in  MEANING  .  .  .  what  is  in 
question  is  the  set  of  meaning  relations 
which  function  in  this  way:    the  semantic 
resources  which  are  drawn  on  for  the 
purpose  of  creating  text.    And  since  ... 
it  is  the  sentence  which  is  the  pivotal  entry 
here  .  .  .we  can  interpret  cohesion,  in 
practice  as  the  set  of  semantic  resources 
for  linking  a  SENTENCE  with  what  has  gone 
before  (Halliday  and  Hasan,  1976,  10). 
Elsewhere,  Halliday  and  Hasan  state  that  "the  concept  of  cohesion 
accounts  for  the  essential  semantic  relations  whereby  any  passage 
of  speech  or  writing  is  enabled  to  function  as  text"  (Halliday 
and  Hasan,  1976,  13).    They  also  state  that  the  cohesive 
categories  "have  in  common  the  property  of  signaling  that  the 
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interpretation  of  the  passage  in  question  depends  ,on  something 
else"  (Halliday  and  Hasan,  1976,  13). 

This  description  of  cohesion  is  diffuse  and  confuses  the 
role  of  cohesion  in  text.    Halliday  and  Hasan  suggest,  for  example, 
that  cohesion  accounts  for  meaning  relations  in  discourse.  Also, 
it  creates  text  by  linking  ideas  encoded  in  sentences.    Not  only 
does  cohesion  account  ^nd  link  and  create,  it  also  enables  and 
signals  as  well . 

It  seems  that  the  relations  that  are  meant  td  exist  between 
ideas  communicated  in  sentences  are  signaled  explicitly  in  text,  ' 
according  to  Halliday  and  Hasan,  primarily  through  the  use  of 
cohesive  ties.    The  key  term  here  is  "signal."   Cohesive  signals 
represent  explicit  attempts  to  signal  the  relationship  between 
immediately  attended  information  and  certain  available  information. 
The  terms  link,  treatg  and  enable  tfend  to  present  cohesion  as  a 
causal  or  constitutive  factor  of  coherence— coherence  is  placed  in 
the  text  for  the  reader. 

^  This  prob^lematic  status  of  the  concept  of  cohesion  is  also 
apparent  in  the  discussion  of  the  cohesion  categories  in  Cohesion 
in  English.    In  the  discussion,  each  example  of  a  tie  is  discussed 
primarily  as  a  separate  phenomenon  without  any  reference  to  the 
.amount  of  inferencing  required  to  interpret  the  individual  tie 
nor  the  tie  as  it  is  complemented  by  other  text  properties.  Such 
discussion  places  a  heavy  burden  on  the  concept  of  cohesion  in  terms 
of  explaining  what  a  text  is  beyond  its  individual  sentences.  As 
a  result,  it  is  tempting  to  treat  cohesion  simply  as  the  sum  of 
cohesive  ties  in  a  text.    In  other  words,  in  treating  reference, 
substitution,  ellipsis,  conjunction,  reiteraVh^nr^nd  co>]oca^ 
as  functionally  similar  entities  defining  textual  cohesionVthe 
tempta^on  is  to  think  of  cohesion  in  text  as  an.  existing,  | 
identifiable,  macro-entity  defining  coherence.    Such  is  the/ 
perspective  from  the  horn  of  the  text. 

With  respect  to  the  theoretical  inadequacy  of  the  concept 

r  • 

of  cohesion,  Morgan  (1978)  and  Morgan  and  Sellner  (1980)  also 
criticize  Halliday  and  Hasan  for  portraying  cohesion  in  Cohesion 
in  English,  as  determining  coherence  for  a  reader  reading  the  text. 


Again^  wfiat  i§  problematic  is  whether  cohesion  maintains  a  super- 
opdinate/causal  or  a  subordinate/consequential  relationship  to  the 
comprehension  of  text. 

For  Morgan  (1978)  and  Morgan  and  Sellner  (1980),  the  problem 
begins  when  interpreting  the  alignment  of  the  concepts  'text*  and 
•cohesion'  in  Cohesion  in  English: 

The  word  TEXT  is  used  in  1 inguistics  to  refer 
to  any  passage,  spoken  or  written,  of  whatever 
length,  that  does  forma  unified  whole  .  .  . 
This  suggests  that  there  are  objective  factors 
involved.    There  must  be  certain  features 
which  are  characteristic  of  texts  and  not 
found  otherwise  (Halliday  and  Hasan,  1976,  1). 
These  objective  factors  turn  out  to  be  cohesive  ties,  and, 
according  to  Halliday  and  Hasan,  they  are  essential  characteristics 
of  text.    The  implication  is  that  objective,  cohesive  factors 
determine  a  text's  coherence  for  a  reader.    Morgan  (1978)  and 
Morgan  and  Sellner  (1980)  criticize  Halliday  and  Hasan  for  this 
implication  and  for  the  general  lack  of  a  cognitive  component  in 
the  description  of  cohesion.    Here,  in  theoretical  terms,  is  one 
basis  for  the  applied  dilemma. 

Morgan  (1978)  and  Morgan  and  Sellner  (1980)  base  their 
criticism  on  a  discussion  of  the  cohesive  tie  connecting  them  and 
6  cooking  apples  given  above.    Morgan  argues  that  the  assertion 
of  a  dependent  relation  of  coherence  to  cohesion  negates  a  reliance 
on  a  cognitive,  inferencing  component  in  the  comprehension  of 
text.    He  claims  that  it  is  this  negation  that  is  at  the  problemati 
core  of  Halliday  and  Hasan's  cohesion  concept: 

There  is  a  vicious  circularity  here.  The 
recipe  has  cohesion,  is  a  coherent  text,  just 
in  case  them  refers  to  the  apples.    But  we  are 
only  justified  in  inferring  that  them  refers 
to  the  apples  if  we  assume  that  the  text  is 
coherefnt.    Thus,  in  spite  of  Halliday  and 
Hasan's  claim,  it  is  not  the  anaphoric  facts 
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that  give  rise  to  the  Inference  that  them 
refers  to  the  apples  (Morgan,  1978,  p.  110). 
Morgan's  argument  Is  summed  up  In  Morgan  and  Sellner  (1980)/ 
Morgan  and  Sellner  criticize  Halllday  and  Hasan  for  making  the 
mistake  to  Interpreting  cohesion  as  source  and^ cause  of  a  text's 
coherence  rather  than  as  a  consequence  of  It: 

The  source  of  coherence  would  lie  in  the  content, 
and  the  repeated  occurrences  of  certain  words 
[examples  of  cohesion]  would  be  the  conse- 
quence  of  content  coherence,  not  something 
that  was  a  source  of  coherence.    It  would 
be  a  serious  mistake  to  construe  the 
linguistic  manifestation  (I.e.,  examples  of 
cohesion)  as  cause,  rather  than  effect. 
(Morgan  and  Sellner,  1980,  p.  25). 
The  criticisms  Morgan  (1978)  and  Morgan  and  Sellner  (1980) 
make  are  not  directed  at  an  articulated  stance  held  by  Hal|1day 
and  Hasan.'   Rather,  as  Morgan  (1978)  points  out,  his  criticism  1s^ 
directed  at  an  underlying  misconception  of  the  role  of  a  text  In 
communication  that  surfaces  not  only  In  the  arguments  of  Halllday 
and  Hasan,  but  also  In  the  unspeclfic  terminology  used  to  describe 
cohesion. 

Ultimately,  In  Cohesion  and  English  Halllday  and  Hasan 
diminish  the  reader's  role  In  constructing  meaning  In  text. 
Coherence  Is  In  the  text  and  In  the  situation  and  very  little  Is 
said  about  the  role  of  the  reader.    Such  little  emphasis  given  to 
the  reader's  ability  to  make  connetctlons  and  to  generate  coherence 
from  a  reglsterally  consistent  and  cohesive  text  works  against 
Halllday  and  Hasan's  description  of  text  coherence.    And  It  Is 
"this  vacuum  which  draws  the  reading  educator  between  the  horns  of 
applied  dilemma. 

The  Use  of  the  Concept  of  Cohesion  by  Reading  Educators 

To  review,  the  apparent  causal  relationship  between  the 
cohesion  variable  and  a  text's  comprehenslblllty  Is  based  on  the 
notion  that  cohesive  ties  determine  coherence.    Thus,  If  text 
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analysis  indicates  that  a  text  uses  an  abundance  of  cohesive  ties, 
then  the  text  is  assumed  to  be  coherent.    It  is  reasoned  that  the 
degree  to  which  ideas  in  a  text  are  related  via  cohesive  ties  is 
the  degree  to  which  relations  between  ideas  are  understood  by  a 
reader.    This  reasoning  is  important  when  considering  text 
analytic  procedures  in  general.    The  use  of  these  procedures  can 
only  become  misused   when  the  product  of  analysis  is  taken  to  be 
a  formal  representation  of  the  meaning  and  coherence  of  the  text. 
Such  misuse  of  text  analysis  treats  the  text  solely  as  an  object 
similar  to  the  sentence  and  capable  of  being  analyzed  in  a  similar 
manner.  , 

The  applied  dilemma  for  the  reading  educator  arises  when 
such  text-based  reasoning  runs  counter  to  reader-based  theorizing 
about  the  process  of  text  comprehension.    For  example,  for  the 
reading  educator  interested  in  a  text's  readability  (and  therefore 
its  comprehensibility)  a  formulaic  approach  to  defining  the 
coherence  Jevel  of  a  text  is  appealing  in  that  it  purports  to 
provide  a  measure  of  the  difficulty  of  a  text  in  terms  of  "how 
well  it  hangs  together."    However,  from  the  perspective  of  the 
horn  of  the  reader,  we  are  reminded  of  schema-theoretic  positions 
on  reading  comprehension  that  stress  the  importance  of  the 
cognitive  abilities  of  the  reader  over  text  characteristics  when 
discussing  the  reader's  comprehension  of  text.    In  the  discussion 
that  follows  all  of  the  arguments  and  research  reported  have  had 
to  face  the  dilemma  we  depict.  * 

For  example,  Moe  (1979)  discussed  the  value  of  the  concept 

of  cohesion.    On  the  horn  of  text,  he  took  the  stance  that  there 

are  aspects  of  comprehensibility  that  are  reader  independent  and 

that  can  be  measured  by  the  number  and  type  of  cohesive  ties. 

As  he  stated,  his  position  was  that  a  tie: 

bridges  sentences  semantically  [and] 

enables  the  reader  to  establish  coherence 

in  text  and  therefore  accounts  for  a  large 

portion  of  this  comprehensibility  in 

written  discourse. 
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Alternatively,  on  the  horn  of  the  reader,  Moe  asserted  that  It 
Is  unacceptable  to  use  the  cohesion  concept  to  predict  the 
effectiveness  of  a  particular  tie.    In  accordance  with  this  view, 
he  suggested  that  It  Is  a  mistake  to  equate  the  cohesion  concept 
with  a  coherence-producing  factor  Inherent  in  text. 

Irwin  (1980)  based  her  work  on  the  notion  that  readability/ 
comprehenslbillty  Is  largely  defined  by  the  degree  to  which 
"sentences  are  conceptually  linked"  for  and  by  the  reader  (1980). 
She  did  not  restrict  herself  to  cohesion  but  Incorporated  it  in  a 
set  of  coherence  factors  that  Included  coherence  between  clauses 
as  represented  In  a  text  analysis  procedure  elaborated  by  Kintsch 
and  van  DIJk  (1979).    Her  general  position  was  that  a  text's 
coherence—Its  comprehenslbll Ity— was  directly  related  to  the 
expllcltness  with  which  the  relationships  between  ideas  In  text 
were  signaled.    In  terms  of  the  applied  dilemma,  Irwin  at  once 
speaks  In  terms  of  the  amount  of  Inferencing  the  reader  Is  called 
upon  to  do,  yet  still  asserts  the  reality  of  reader-Independent^  " 
text  variables  predicting  the  comprehenslbllity/readabllity  of  a 
text  for  a  reader. 

Thomas  and  Bridge  (1980)  seem  similarly  tempted  by  the 
definability  and  measurablllty  of  cohesion.    They  postulated  that 
It  Is  possible  to  use  cohesion  analysis  to  demonstrate  how  closely 
propositions  are  related  according  to  the  number  of  ties  between 
them.    By  assuming  the  power  of  cohesion  to  estjfblish  coherence, 
the  number  of  ties  between  propositions  is  used  to  explain  why  a 
proposition's  generated/recalled  most  often  in  a  summarizing  task. 
Yet  they  too  discover  the  power  of  the  reader  in  concluding  from 
their  data  that  cohesion  does  not  account  for  comprehension 

differences  between  readers. 

In  her  dissertation,  Rhodes  (1980)  clearly  represented  the 
Inadequacy  of  working  solely  from  the  horn  of  the  text.  Rhodes 
hypothesized  that  first  grade  basal  texts  written  with  a  decoding 
orientation  toward  beginning  reading  instruction  would  provide 
passages  with  "semantic  structures"  different    from  basal  texts 
written  with  a  wholes-language  orientation  toward  beginning 
reading  instruction.    She  predicted  that  these  semantic  structures 
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would  affect  students'  reading  strategies  and  hence  their  compre- 
hension of  text.    Rhodes  used  two  text  analysis  systems  to  define 
a  text's  semantic  structure,  Halliday  and  Hasan's  (1976)  analysis 
used  to  identify  and  describe  links  between  ideas  in  a  text  at  a 
surface  text  level,  artd  Stein  and  Glenn's  (1978)  story  grammar 
analysis  used  to  identify  and  describe  text  at  a  'deep  structure' 
level.    She  found  that  simply  counting  cohesive  ties  could  not 
predict  reader  performance,  and  that  the  effectiveness  of  a  tie 
was  not  related  to  its  mere  presence  in  a  text. 

As  a  final  example  of  a  reading  study  investigating  cohesive 
and  concluding  against  its  coherence-producing  character,  Teddlie 
(1979)  looked  at  text  variables  influencing  a  reader's  resolution 
of  anaphoric  relationships  in  text.    She  used  Halliday  and  Hasan's 
cohesion  analysis  to  identify  anaphoric  relations  in  text,  but 
characterized  them  as  first-stage  inferences  in  the  reading 
process.    Thus  she  asked  the  general  question  of  the  actual 
psychological  im|)ortance  of  anaphoric  resolution  in  the  reader's 
creation  of  coherent  meaning.    Oif  importance  in  Teddlie's  study 
was  the  fact  that  she  approached-Hfflliday  and  Hasan's  concept  of 
cohesion  as  a  text  analysis  system,  an  efficient  means  of  coding 
anaphoric  relations  and- enabling  their  quantification.  For 
Teddlie,  cohesion  analysis  was  only  a  means  of  identifying, 
isolating  arid  quantifying  anaphoric  relations  in  text  and  said 
nothing  about  the  cognitive  process  of  anaphoric  resolution.  She 
also  found  that  the  cohesion  concept  did  not  predict  recall  of 
major  referents  in  text. 

As  is  clear  in  all  of  these  reading  studies,  it  is  not  the 
case  that  cohesion  represents  a  reader-independent  text  variable 
predictir^g  and  explaining  comprehension  of  text.    Rather,  a^--. 
theoretically  more  appropriate  position,  stressed  by  Tgrfdne,  isj 
to  view  cohesion  analysis  and  text  analysis  systems  i^^j^neral 
as  bookkeeping  systems.    In  other  words,  text  analysis  systems 
provide  a  tool  for  managing  texts  while  investigating  questions 
of  reading  comprehension -it  is  not  a  tool  for  describing  a  text's 
coherence  or  for  explaining  reading  comprehension. 
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Two  composition  studies  using  the  cohesion  concept  also 
conclude  against  its  usefulness  as  a  predictor  of  a  text's 
coherence  for  a  reader.    Pritchard  (1980)  looked  at  the  composi- 
tions of  good  and  poor  writers  In  terms  of  the  cohesive  ties  used. 
He  started  out  with  the  assumption  that  writers  not. only  need  to 
compose  well  formed  sentences,  but  they  need  to  establish  ties 
between  sentences  thereby  creating  coherent  text.  *  He  Interpreted 
cohesion  as  a  local,  measurable,  linguistic  phenomenon  (as 
defined  by  Halllday  and  Hasan)  and  coherence  as  a  non^measurable 
r^Hrence  to  a  text's  degree  of  connectedness  or  wholeness.  That 
Pritchard  does  not  speak  In  terms  of  how  coherently  the  writer  Is 
able  to  think  about  his  topic.  Indicates  the  extent  to  which  he 
accepts  the  notion  that  the  cohesive    concept  Is  Indeed  reader 
(or  In  this  case,  writer)  Independent  and  constitutive  of  a  text's 
coherence. 

Interestingly,  Pritchard  found  that  the  greater  use  of  f 
cohesl-ve  ties  characterized  the  problem  se^ctlons  (not  the  more 
coherent  sections)  of  compositions  written  by  poor  writers-  He 
concluded  that  counting  and  categorizing  cohesive  ties  (the  method 
of  cohesion  analysis)  fs  not  a  measure  of  how  effectively  ties 
a^e  used.    In  other  words,  cohesion  analysis  Is  not  a  measure  of 
coherence. 

In  their  cohesion  study,  Tierney  and  Mosenthal  (1981),  like 
the  other  researchers  mentioned  above,  started  out  with  the 
assumption  that   cohesion  In  text,  as  characterized  by  Halllday 
and  Hasan,  might  be  able  to  predict  and  explain  much  of  a 
reader's  comprehension  of  text.    However,  they  found  that  cohesion 
analysis  does  not  predict  or  det^ermlne  textual  coherence  for  a 
reader.    After  having  studertt  writers  write  on  two  different 
topics,  with  a  group  of  writers  familiar  with  one  of  the  topics, 
cohesion  analysis  of  the  student  texts  revealed  significant 
differences  between  texts  written  on  -the  two  different  topic? , 
but  no  difference  between  familiar  and  unfamiliar  writers  writing 
on  a  common  topic.    In  other  words.  In  line  with  tfie  arguments 
of  Morgan  (1978)  and  Morgan  and  Sellner  (1980),  they  found  that 
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It  makes  more  sense  to  talk  of  cohesion  as  a  consequence  of  content 
coherence  and  content  differences  and  not  as  a  determinant  or 
even  a  consequence  of  coherence  differences  betweea  writers 
familiar  or  unfamiliar  with  the  topic. 
Summary  and  Reappraisal 

It  Is  our  thesis  that  reading  educators  are  on  the  horns  of 
an  applied* dilemma.    This  dilemma  manifests  Itself  in  conjunctiofij^ 
with  the  seductiveness  of  Hal liday  and  Hasan's  presentation  of 
ccjhesion  and  the  faulty  argumentation  it^prompts.    The  i'au^lty 
argument  runs  as  follows:    (1)  the  notion  of  cohesion  in  text  is 
defined  linguistically  in  terms  of  Instances  of  reference, 
substitution,  ellipsis,  conjunction,  reiteration,  and  collocation; 
(2)  by  definition,  anything  about  a  text  that  is  cohesive  is. 
attributable  to  the  use  of  these  cohesive  ties;  (3)  cohesion  is  by 
definition  the  sum  of  these  ties;  and  (4)  this  quantifiable  feature 
of  text  is  causally  related  to  a  text's  coherence  for  a  reader. 
For  reading  e^bft^^ion  research,  'this  is  a  very  appealing  argument 
since  it  means  that  a  text's  coherence  level  is  identifiable,  and  . 
reader  performance  can  be  assessed/predicted  based  on  a  kind  of.  , 
coherence  coefficient  for  a  text,    But  as  Morgan  points  out,  this 
argument  is  problematic.    Ratheiu  in  a  text,  if  term  X2  is,  used 
to  refer  to  the  same  concept  Y  as  rs  term     ,  this  Intent  is 
fulfilled  because  a  reader  comprehends  or  Infers  that  )^2  is  the 
presupposing  item  and  X^  the  presupposed  item  in  a  cohesive  tie. 
It  is  not  the  case  that  a  cohesive  tie  constifetttes  the  'tie'  in 
the  mind  of  the  reader. 

Tierney  and  Mosenthal  (1981)  and  Tierney,  Mosenthal  and 
Kantor  (1980)  conclude,  in  reviewing  and  reappraising  text-analysis 
systems,  that  from  an  applied  point  of  view  it  is  best  to  assert 
the  value  of  the  cohesion  concept  in  singling  out  individual  items-- 
anaphoric  items,  connectives,  lexically  cohesive  items,  etc.— as 
possible  sources  of  ambiguity  for  the  reader  (not  sources  of 
coherence).    From  this  perspective  there  is  not  a  total  cohesion 
effect  for  a  text  but  individual  Instances,  exhaustively  identified 
by  a  text  analysis  system,  where  ambiguous  Instances  of  cohesion 
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might  detract  from  the  local  coherence  of  the  text  at  the  point 
where  ^e  cohesive  item  is  encountered. 

Such  suggestions  can  be  used  by  the  classroom  teacher.  These 
suggesti|pns  minimize  the  importance  of  a  coherence  Coefficient  and 
instead  aim  to  help. the  classroom  teacher  be  more  aware  of  possiyite 
sources  of  ambiguity  for  a  reader.    Indeed,  at  the  Classroom  level , 
it  ts  suggested  that  it  is  not  the  text  analysis  systems  that  are 
important,  put  an  awareness  of  text  characteristics  that  can  help 
in  identifying  ambiguous'^'are^  in  text  affecting  reader  inter- 
pretation.   Perhaps  from  this/ perspective,  our  dilemma  will  become 
a  cautidus  appreciation  of  the  conflicting,  narrow  imperatives 
pqsed  by  either  horn,  the  text  and  the,  reader,  when  con^sidered  in 
isolation. 


------ .  -^-^ 
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Our  dijscussion  so  far  in  this  report  has  been  concerned  with  describing 
,    ■  p  ■    • .  ' '  '  . 

text  langfuage  and  identifying  factors  that  contribute  "to  its  comprehensibil  ity. 

The  primary  method  of  selecting  text  features,  that  are  relevant  in  making 

a  text  comprehensibl  e/^as  been  recall.    As  "described  in  Part  3  of  Secti-on  III,  we  asked^ 

students  to  learn  text  samples  taken  from  their  textbooks.    In  analyzing  the 

data  generated  by  comparihg  what  stiidents  remembered  from  the  texts  with  what 

we  determinecf  the  author  intended  for  them  to  learn,  we  averaged  across 

students  for  any  one  idea  presented  in  a  text  and  used  text  units  as  the  ^ 

repl  ication' factor .    Thus  our  findings  reported  in  Section  IIIaT  are  general izable 

to  other  text  units  from  the  same* population  we  identified.    However,  the 

results  still  need  ta  be  confirmed  by  analyzing  the  data  with  subjects  as  the 

replication  factor  and  individual  sabject's  scores  generated  by  averaging  across 

text  units  of  any  ane  type.  '  > 

In  this  section,  we  present  two  reports  in  which  "subjects'*  is  the 
replication  factor.    In  Part  I,  we  summarize  th6  results  of  our  attempts  to  ^ 
test  the  influence  of. reader  characteristics  (gender  and  course  topic)'  on  recall, 
identification  of  main  ideas  and  metacognition  ratings.    In  Part  II,  we  report 
results  of  a  study  in  which  relational  mappjng  was  used  to  describe  college- 
level  Geology  discourse  and  students'  response  to  that  instructional  setting 
was  assessed.  . 

PART  I.    ll^IVlDUAL  DIFFERENCES  IN  LEARNING  FROM  BIOLOGY  AND  HISTORY  TEXTS 

Diane  L.  Schallert,  Diane  M.  Estes,  Sarah  L.  Ul.erick,  Robert  J.  Tierney 

In  considering  the  influence  of  reader  characteristics  on  how  "learnabl^" 
textbook  language  ^is,  we  were  interested  in  whether  men  and  women  students  would 
respond  differently  to  History  and  Biology  samples.    As  argvied  in^^our  proposal, 
it  seemed  reasonabl e' to  predict,  that  gender  differences  would  show  up  when  looking 
at  texts  from  two  topics,  one  ^Biology)  identified  as  a  science    and  likely 
to  be  favored  by  men  students',  the  other  (History)  more  neutral  in  its  connection 
with  either  sex.    We 'proceeded  (i^  taking  the  data  generated  from  the  procedure 
described  in  Section  III .2 ^and  111.3  as  the  basis  of  our  reader  analyses. 
In  the  earlier  section,       have  described  only  the  recall  data,  and  have  used 
only  text  units  as,  the  repl  ication  factor.    Those  data  involve  an  amazingly  large 
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and  complex  set  of  points  and,  since  on0  additional  purpose  -ef  the  by-subjects 
analysis  reported  here  was  to  confirm  the  by-text  unit  analysis,  we  determined 
that  we  would  reduce  the  complexity  of  the  data  base  by  looking  at  only  some 
of  the ^xts  and  some  of  the  students'  responses  to  those  texts.    Thus  we  report 
a  test  of  the  gender  and  topic  factors  for  recall ,  main  idea  identification, 
"and  metacognition  measures  taken  from  12  of   the  30  texts  in  the  original  sample. 

Method/  ,  V. 

Subjects 

The  dattf  analyzed  and  reported  in  this  section  were  provided  by  a  sub-sample 
of  the  subjects  described  in  Section  III. 2.    These  subjects  were  students  ia  six 
different  classrooms  in  central  Illinois.    There  were  57  students  enrolled  in 
high  school  level  introductory  Biology,  23  men  and  34  women,  and  71  students 
in  American  History  classes,  46  men  and  25  women. 

Materials  "  ' 

Six  History  texts  were  represented  (Texts  #219,  222,  223,  226;  227, and  228, 
see  Appendix  D)  and  six  Biology  texts -(Texts  #1 01 ,  103,  106,  107,  llO'and  112). 
The  recall  data  were  generated  by  asking, students  to:  < 

Please  write  down  in  as  much  detail  as  you  can  the 
information  you  have. just  read.    Don't  worry  about 
spelVing^and  grammar.    Do  the  best  you  can  in  writing 
down  everything  you  remember. 

The  main  idea  identification  involved  presenting  students  with  the  following 

instructions:  '  "  ^ 

Below  we  have  listed  eight  statements  that  represent'  ^ 
ideas  /rom  the  section  you  read,    llead  through  all 
of  them  and  then  choose  the  three  (3)  most  important 
ideas  that  represent  the  main  points  of  the  text. 
Indicate  your  choice  by  circling  the  number  -in  front 
^  of  the^  statements.    CH003E  ONLY  THREE. 

The  statements  reflected  our  judgment  of  what  the  main  point(s)  of  a  text 
^.was  and  usual  ly  coincided  with  ideas  high  i'n  the  map  of  the  text. 

The  metacognition  measures  used  in  these  reader  analyses  involved  responses 
to, the  first  and  second  rating  tasks. 


First  rating; 

Before  you  have  a  chance  to  read  the  passage,  predict 
how  well  you  believe  you  will  understand  the  following 
section  which  is  taken  from  your  textbook  for  this  class. 
^Circle  the  appropriate  number. 

1  'ir  3  4 

very  well  well  not  well     not  very  well 

•  at  all 

Second  rating: 

Do  you  believe  you  understood  the  section  you  just  read? 
Circle  the  appropriate  number. 

'% 

1  2  3  4 

very  well  well  not  well     not  very  well 

at  all 

Procedure 

As  described  in  more  detail  in  Section  111.3,  the  students  followed  a 
sequence  of  steps  as  they  responded  to  text  samples  taken  from  their  textbooks: 
(1)    they  read  introductory  instructions;  (2)*^they  were  asked  to  predict 
how  well  they  thought  they  would  understand  an  excerpt  from  the  textbook; 
(3)  they  read  and  learned  a  sample  text  (self-paced);  (4)  they  rated  how 
well  thejj;  had  understood  the  text;  (5)  they  generated  a  free  recall;  (6)  they 
answered  short-answer  questions  about  the  text;^  (7)  they  selected  the  three 
most  important  ideas  from  a  list  of  8  statements  generated  from  the  text; 
and  (8)  they  rated  how  well  they  had  done  on  the  three  measures  of  their 
understanding  of  the  text.^  These  eight  steps  were  presented  three  times  to* 
the  students,  once  in  a  .quick  run-through  with  a  practice  text  and  then  again 
with  two  of  the  30  texts  in  bur  sampfe.    For  purposes  of  the  analyses  reported 
in  this  section,  only  {he' responses  to  the  first  of  the  two  Veal"  texts  were  used. 


Responses  to  these  questions  were  never  analyzed.        decided  after 
gathering  the  measure,  that  the^ questions  we  had  asked  were  not 'well  formulated. 
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Results 

Recall 

The  text  description  that  is  the  basis  of  scoring,  Identified  as  the 
list  of  relationship  proportions  In  relational  mapping,  together  with 
the  details  of  the  scoring  procedure  are  reported  In  Section  III. 3.  For 
purposes  of  these  analyses,  proportions  were  calculated  for  each  subject;.  "-^ 
representing  the  extent  of  high-level  {1  or  2  enjbeddedness  levels)  and  low- 
level  (3  or  more  embeddedness  levels)  recall  he  or  she  generated.  Thes'e 
proportions  were  calculated  for  Al Is  (whole  proposition  scores)  and  for 
Parts  (any  part  --concepts  or  relationship  --  of  any  proposition). 

The  scores  were  entered  Into  two  Gender  by  Topic  (Biology,  History) 
by  Level  (high,  low)  analyses  of  variance.    In  both  analyses,  there  were 
significant  main  effects  for  Topic  and  Level,  £<.001.    Students  produced 
a  greater  proportion  of  whole  propositions  (x  =  .34)  and  of  parts  of  propositions 
(x  =  .36)  when  learning  Biology  texts  than  when  learning  History  texts 
(x  =  .22  and  .26,  respectively).    They  also  produced  a  greater  proportion 
of  the  high-level  propositions  (x  =  .31)  and  of  the  parts  from  high-level 
propositions  (x  =  .34)  than  from  Tow-level  propositions  (x  =  .25  and  .28). 
Gender  was  not  a  significant  factor  and  neither  were  any  of  the  interactions. 

Main  Idea  Identification 

The  eight  statements  on  main  idea  measure  were  assigned  to  either  a  correct 
(major  point)  or  incorrect  (minor  point)  category.    Subjects*  choices  were  then 
compared  to  the  categorized  list  and  scores  determined  by  counting  the  number 
of  main  ideas  chosen  (maximum  score     3).    These  scores  were  then  entered  into 
a  Gender  by  Topic  (Biology,  History)  analysis  of  variance. 

The  only  statistical  significance  was  found  for  Topic  with  a  mean  of  2.04 
for  Biology  and  a  mean  of  2.45  for  History ,  £^  .002.    Men  and  women  students 
did  not  differ  in  their  ability  to  select  main  ideas.    Note  that  all  of  the 
means  were  above  2,  indicating  that  our  high  school  students  were  able  to 
choose  at  least  two  out  of  three  of  the  main  ideas  presented  in  text. 

We  also  calculated  the  correlations  between  students*  recall  scores  and 
main  idea  identification  scores.    The  correlations. were  all  quite  low,  ranging 
from  -.28  to  .20,  and  none  were  significant.    Thus,  whether  students  were  able 


to  recognize  main  points  from  the  passage  was  not  related  to  their  ability 
(and  willingness)  to  produce  either  high  or^ low-level  ideas  in  their  recall. 

Metacognition  Ratings 


Our  first  analysis  Involved  a  Gender  by  Topic  analysis  of  variance  of  the 
responses  to  the  first  metacognition  measure.    We  see  this  measure  as  reflecting 
both  how  well  the  students  estimate  they  have  fared  in  their  previous  dealings 
with  the  textbook  and  how  confident  they  are  in  their  ability  to  handle  future 
encounters  with  the  textbook. 

Results  "indicated  a  significant  Interaction,  £<  .05,  between^  the  two  factors 
that  ran  counter  to  our  expectations.    Men  in  Biology  classes  were  less  confident 
of  their  abili.ty  to  deal  with  their- text  (x  =  2.22)  than  women  (x  =  2.03)  while 
the  reverse  was  true  in  History  classes  (men  =  2.00;  women  =  2.32).  Note 
that  the  low  scores  on"  this  measure  indicate  a  high  degree  of  confidence 
(T  =  very  well,  4  =  not  very  well  at,  all). 

Finally,  an  analysis  was  performed  on  students'  reponses  to  the  second 
metacognition  rating  which  appeared  immediately  after  the  text  and  before  any 
of  the  knowledge  measures.    Correlations  were  calculated  between  the  meta- 
cognition rating  and  the  level  of  recall  demonstrated  for  high-level  and 
low-level  propositions.    Note  that  here,  negative  correlations  reflect  accurate 
predictions  on  the  part  of  students  of  how  good  their  performance  would  be. 
Table  5.1  lists  the  correlation  coefficients  for  the  Gender  by  Topic  by 
Level  categories. 


Topic 


Table  5.1 

Correlation  coefficients  between  predicted  level  of 
and  actual  recall  scores 

Level  of  Proposition' 
 Gender  Hi^h  Low 


Men 


0.39* 


0.39* 


Biology 


0.58* 


0.47* 


Women 


Men 


0.31* 


0.01 


History 


0.04 


0.42* 


Women 


*£<.05 
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Women  Biology  student^  were  quite  accurate  In  predicting  how  well  they 
would  do  in  recalling  both  high-level  and  low-level^  ideas.    Of  the  History 
students,  the  men  were  somewhat  less  but  still  significantly  able  to  predict 
recall  of  high-level  ideas  and  the  women  were  able  to  predict  recall  of 
low-level  ideas.    The  men  Biology  students,  however,  showed  significant 
correlations  between  ratings  and  performance  that  were  in  the  opposite  direction. 
Thus  when  fthey  predicted  they  would  do  well,  they  were  likely  to  do  poorly, 
and  vice  versa. 

Discussion 

In  summary,  then,  results  indicated  that  the  gender 'of  subjects  made 
no  difference  when  it  came  to  performance.    Men  and  women  students  did  not 
differ  in  their  ability  to  recall  ideas  from  textbook  samples  or  to  identify 
main  idea  statements  taken  from  the  samples.    Men  and  women  did  differ  in 
their  confidence  ratings  of  how  well  they  could  learn  from  text  samplies  but 
the  pattern  ran  counter  to  colloquial  expectations.    Women  Biology  students 
predicted  they  would  understand  their  text  better  than  men  Biology  students 
and  the  reverse  was  true  for  History  students.    Finally,  the  only  other  com- 
parison that  indicated  a  sex  difference  was  the  correlation  measures  between 
how  well  students  had  understood  a  text  and  how  well  they  recalled  it.  Here, 
women  showed  high  negative  correlations  particularly  for  Biology  texts, 
indicating  that  their  ratings  reflected  accurately  the  state  of  their  knowledge. 

In  terms  of  topic  differences,  contrary  to  expectations.  Biology  students 
produced  more  complete  recalls  than  History  students,  although  generally 
for  both  topics  performance  was  relatively  low.    The  reverse  was  true  when 
it  came  to  recognizing  statements  as  representing  main  ideas  taken  from  the 
text.    Here,  performance  was  high.    The  two  performance  measures,  however, 
were  not  correlated.    One  explanation  of  these  results  -may  be  that  the  pro- 
duction (as  in  recall  measures)  of  ideas  required  more  effort  than  the 
recognition  of  ideas  and  thus,  may  involve  to  a  greater  degree  a  free-floating 
motivational  factor  that  we  did  not  assess. 

Finally,  results  of  both  performance  measures  corroborated  the  by-text-unit 
analyses  reported  earlier  that  Indicated  high-level  ideas  as  more  memorable 
than  low-level  ideas. 


PART  2:    LEARNING  FROM  INSTRUCTIONAL  DISCOURSES  IN  A  COLLEGE  GEOLOGY 
COURSE 

Sarah  L.  Ulerick 

College  science  courses  take  place  in  complex  instructional 
settings  where  related  Information  Is  conveyed  in  more  than  one  mode 
or  presentation  of  instruction.    In  the  geology  course  studied  here, 
ftor  example,  related  Information  was  presented  in  the  textbook,  the 
professor's  lecture,  the  laboratory  manual,  and  the  laboratory 
session.    Each  presentation  had  Its  own  content  and  organization 
from. which  students  extracted  and,  hopefully.  Integrated  Information. 
The  purpose  of  this  study  was  to  examine  factors  within  a  complex 
Instructional  setting  which  may  Influence  students'  abilities  to 
acquire  and  Integrate  Information  from  Instructional  discourse. 

The  study  borrows  the  methodological  paradigm  of  discourse 
comprehension  research  and  regards  college  geology  Instruction 
essentially  as  learning  frOR)  discourse.    The  textbook  and  lecture 
portions  of  an  Introductory  geology  course  primarily  Involve 
students'  listening  to  or  reading  verbal  material.    In  an  observa- 
tional sXudy  of  college  science  laboratory  behaviors,  Kyle,  Penick, 
and  Shymansky  (1979)  reported  ,t^at  learning  from  discourse 
(listening  or  reading)  accounted  for  an  average  of  35%  of  behaviors 
across  five  sciences.  Including  geology.    In  Introductory  geology 
laboratory  classes,  nearly  55%  of  the  students'  behaviors. were 
listening  or  reading.    Despite  the  fact  that  learning  from  Instruc- 
tional discourse  Is  a  significant  aspect  of  college  science 
learning,  very  little  Is  known  about  aspects  of  discourse  which 
may  facilitate  students'  comprehension  and  acquisition  of  knowledge 
In  such  settings. 

From  a  congltlve  view,  comprehension  occurs  when  learners, 
given  their  particular  prior  knowledge  structures.  Interact  with 
prose  materials,  given  their  particular  content  structures  or 
organizations  (Ausubel ,  Novak,  &  Naneslan,  1987;  Bransford,  1979). 
Discourse  comprehension  researchers  have  focused  variously  on  one 
or  the  other  of  these  factors.    In  a  typical  study  about  the 
Influence  of  content  structures  on  discourse  (e.g.,  Johnson,  1970; 
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Meyer,  1975,  1977)  subjects  would  read  a  brief  expository  passage 
and  later  recall  Its  contents.    The  subjects'  recalls  would  provide 
evIdence^'OT- their  knowledge  acquisition.    The  content  structure  of 
the  passage  would  have  been  analyzed  by  some  method  of  text  analysis 
(see  reviews  An  Meyer,  1975;  and  Tierney  &  Mosenthal ,  1980)  so  that 
elements  In  subjects'  recalls  could  be  related  to  specific  aspects 
of  text  structure. 

In  a  complex  Instructional  setting  the  discourse  ''passages"  are 
lengthy  Instructional  presentations.    In  this  study  the  discourses 
were  the  textbook  chapter,  the  professor's  lecture,  and  the  labora- 
tory manual  chapter.    The  content  structures  of  the  three  presenta- 
tions were  described  by  means  of  relational  "mapping,  described  in 
Section  III.    The  mapping  provided  a  basis  for  generating  quiz 
questions  which.  In  place  of  free  recall,  provided  a  measure  of 
students*  success  In  acquiring.  Integrating,  and  transferring 
knowledge. 

Discourse  comprehension  researchers  have  confirmed  that  certain 
features  of  content  structures  are  predictive  of  recall.  Studies 
In  this  area  have  demonstrated  that  subjects  tend  to  recall  more 
frequently  elements  or  "pieces  of  Information"  which  are  high  In 
text  structure;  that  Is,  elements  which  are  relatively  more 
Important  or  superordlnant  (Johnson,  1970;  Kintsch  &  van  Dijk,  1978; 
Meyer,  1975,  1977).    Also  subjects  tend  to  recall  more  Information 
from  semantlcally  coherent  text  (Kintsch  &  Vipond,  1979;  Walker 
&  Meyer,  1980).    A  few  researchers  (Marshall  &  Glo^,  1978-1979) 
have  also  explored  the  effects  on  recall  attributable  to  the  types 
of  relationships  expressed  In  text  and  the  expllcltness  or 
Implicitness  of  the  Ideas  expressed  In  text.    Findings  with  respect 
to  thes^  latter  two  factors  are  not  conclusive. 

Thus  far,  the  concerns  of  discourse  comprehension  researchers 
have  been  confined  primarily  to  experimental  settings  where  subjects 
read  and  recall  brief  expository  passages.    Research  has  not  yet 
determined  whether  features  of  content  structure  may  be  recognized 
In  natural  Instructional  discourses;  or  whether  such  features 
actually  Influence  learning  outcomes  In  the  classroom.    The  present 
study  transfers  both  the  concerns  and  the  methodology  of  discourse 
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comprehension  research  to  the  Instructional  realm  of  science  education 
research  In  the  hope  of  expanding  our  abilities  to  describe  and 
analyze  learning  In  complex  Instructional  settlfjgs.    The  major  research 
questions  were:    (1)  Do  students  In  an  Introductory  college  geology 
course  perform  differently  on  questions  of  literal  knowledge  versus 
Integration  of  knowledge  versus  transfer  of  knowledge Do  content 
structure  features  such  as  tontent-match ,  Importance,  expl Icltness , 
or  manner  of  relationship  Influence  students'  performance  on  literal 
questions?;  and  (3)  Do  special  task  Instructions  encouraging  students 
to  synthesize  or  Integrate  knowledge  Improve  their  performance  on 
literal,  integration,  or  transfer  questions? 

Method 

Subjects 

Subjects  were  students  In  a  large  Introductory   geology  course 
Intended  for  nonmajors  at  The  University  of  Texasyat  Austin.  Subjects 
attended  two  one-hour  lectures"- and  a  two-hour  laboratory  session 
each  week,.    Of  the  314  students  In  the  class,  -230  (73«>  participated 
In  the  study.    Due  to  the  design  of  the' research,  however,  most 
results  represent  the  performance  of  a  reduced  sample  of  117  students, 
randomly  drawn  from  the  larger  group  of  participants.  . 

Approximately  two-thirds  of  the  group  were  freshmen  and  sopho- 
mores.   About  half  of  the  group  were  majoring  In  business.  The 
average  grade-point  of  the  students  for  the  previous  semester  was 
2.83., 
'Materials 

The  materials  consisted  of  three  Instructional  presentations 
about  the  topic  Igneous  rocks,  and  the  quiz  questions  that  tested 
students.'  acquisition.  Integration,  and  transfer  of  knowledge.  A 
major  aim  of  the  research  was  to  describe  how  Information  was 
organized  In  natural  Instructional  discourses;  the  steps  by  which 
this  was  achieved  are  reviewed  In  "Describing  content  structures." 
The  nature  of  the  three  types  of  quiz  questions  and  how  they  were 
generated  are  explained  under  "Generating  quiz  questions."  In 
order  to  tie  students'  performance  on  parti ctiTar^lz  questions 
to  the  Instructional  discourses  and  their  content  structures,  the 
questions  were  characterized  by  a  number  of  text-derived  features: 


content-match.  Importance,  expUdtness,  and  relationship  type. 
The  methods,  both  analytical  and  empirical,  by  which  these  features 
we,re  determined  are  described  under  "Defining  text-derived  charac- 
teristics." 

Describing  content  structures.    The  instructional  presentations 
about  igneous  rocks  were  the  textbook  chapter  (Long,  1974),  the 
professor's  lecture  and  the  laboratory  manual  chapter  (Hamblin  & 
Howard  ,  1980>.    Content  structures  were  described  and  analyzed  by 
means  of  relational  mapping. 

The  instructional  discourses  were  mapped  at  an  overview  level. 
That  is,  only  main  ideas  of  summary  concepts  and  their  interrela- 
tionships were  selected  to  be  mapped.    In  this  way  it  was  possible 
to  produce,  for  example,  a  three-page  map  which  summarized  the 
twenty-page  chapter  from  the  text^k.    A  portion  of  the  map  of  the 
textbook  chapter  is  shown  in  PTgure  5.1.  — 

From  the  maps  it  was  readily  apparent  that  related  information 
was  presented  1n  each  discourse,  but  with  differing  emphasis  and 
surrounding  Information.    For  example.  In  the  textbook  chapter 
"dikes"  were  discussed  as  a  feature  of  Icelandic  volcanic  eruptions 
which  are  extrusive  Igneous  events.    In  the  lecture,  however,  dikes 
were  contrasted  only  with  bathollths,  which  were  both  described  as 
examples  of  Intrusive  Igneous  features.    The  mapped  versions  of  the 
discourses  clearly  Illuminated  the  problem  students  faced  In  trying 
to  acquire  and  Integrate  related  Information  Into  a  coherent 
knowledge  structure.    The  maps  further  served  as  the  basis  for 
Identifying  topics  In  common  to  two  or  more  presentations.  The 
topics  provided  the  content  for  generating  quiz  questions. 

Generating  quiz  questions.    Three  types  of  quiz  questions  were 
composed:    literal.  Integration,  and  transfer.    Literal  questions 
asked  about  content  which  was  stated  completely  within  one  discourse. 
These  corresponded  most  closely  to  low-level  cognitive  questions 
(Bloom,  Engelhart,  Furst,  Hill,  &  Krathwohl ,  1956).^  Integration 
questions  tested  students'  abilities  to  tie  together  Information 
that  was  related  but  not  explicitly  connected  In  the  Instructional 
discourses.    Nearly  all  of  the  Integration  questions  were  linked  to 
specific  literal  questions  that  tested  premise  Information. 
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Integration  questions  were  similar  to  Anderson's  (197'^  "comprehension'* 
questions.    Last,  a  small  number  of  trah^fer  questions  tested  students* 
application  of  literal  and  integrated  knowledge  in  new  problem 
situations.    A  similar  usage  of  th^  notion  of  transfer  can  be  found 
in  a  study  by  Mayer  and  Cook  (1981),  where  transfer  questions 
"required  conceptual  understanding  of  several  text  principles  that 
would  be  applied  to  novel  problfiTn  situations  not  addressed  in  the 
te'xt  itself"  (p.  103). 

Three  twentiy-question  quizzes  were  constructed,  containing  a 
total  of  39  literal  questions,  15  integration  questions,  and  6 
transfer  questions.    A  few  questions  were  xJropped  from  analysis 
after  administering   the  quizzes  because  tmpy  had  especially  low 
"p"  and  "Rpfjjg"  values  on  initial  item  analysis  results.    The  final 
question  sets  contained  37  literal  questions,  14  integration  questions, 
and  6  transfer  questions.    Table  5.2  displays  two  literal  questions 
and  the  integration  question  drawn  from  them. 

Defining  text-derfved  characteristics.    Literal  questions  were 
characterized  in  terms  of  four  text-derived  characteristics:  content- 
match,  importance,  explicitness,  and  relationship  type.  Content- 
match  was  defined  as  the  similarity  between  the  superordinate  and 
subordinate  concepts  and  relationships  surrounding  a  given  concept 
or  topic  found  in  two  or  more  presentations.    Content-match  was 
determined  by  analyzes  of  several  features  derived  from  th^  content 
structure  maps:    (1)  the  superordinate  relationship  which  initially 
introduced  a  giveY)  topic;  (2)  the  approximate  "level  of  emb^dedness" 
or  indentation  of  the  topic  in  the  map;  (3)  the  number  of  sub- 
ordinate concepts  to  the  topic;  and  (4)  the  types  of  subordinate 
relationships.    Ratings  assessed  the  degree  of  content-match  on  a 
5-point  scale,  with  "1"  being  "very  similar"  and  "5"  being  "very 
different."    Topics  which  received  ratings  at  the  extreme  ends  of  the 
scale  were  c*haracterized  as  either  content-same  or  content-different. 
The  topic  "igneaus  dikes,"  previously  mentioned,  represented  a 
content-different  topic.    Among  the  literal  questions,  18  asked 
about  content-same  topics  and  19  asked  about  content-different  topics. 
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Jytd  literal  questlon^from  a  content-different  topic  and  the 
Integration  question  based  on  them. 

LITERAL  QUESTIONS:  /  / 

Craters  differ  from  calderas  In  that: 
.qalderas  are  much  smaller. 
V  much  more  fluid  lava  1s  erupted  from  craters  than  frbm 
/      calderas.  r 

•  craters  are  found  on  the  summit  of  a  vol cano ,  jwhereas 
calderas  are  found  Only  on  the  flanks. 

•  craters  originate  by  building  up  on  material,  whereas 
calderas  originate  by  removal  aad  collapse  of  material. 

C»'ater-bdke-s1n^ Oregon,  was  forme'd  ,when:  ^ 

•  the  tojj  of  a  large  volcano  collapsed,  and  the  fesult- 
and  liole  then  filled  with  water. 

•  a  lava  lake  like  the  one  In  Hawaii  cooled  and  was  then 
covered  wUh  water.  /        ^    '  \ 

•  a  landslide-  dammed  a  river  flowing  down  the  mountain, 
causing  the  vent , crater  at  ^^^e  summit  to  fVll  with  water. 

•  pyroclastic  debris  was  piled  up  as  high-sided  walls 
around  the  central-  vent  wMch  tiien  filled  with  water.  ' 

integration' go EST I ON:  >   ,  ' 

Grater  Lake,  In  Oregon,  fills  a: 

•  caldera. 

•  crater. 

•  fissure. 


V 


lava  lake.  * 


y 
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ImpiSrtance  and  explicitnes^s  were  determined  by  seven  raters  who 
assessed  eaoh  questions'  content  rial ative  to  its  instri/ctTonc|l 
source.   Three  of  the  raters  wece  experts      relational  mapping  and 
'four  were  geology  graduate  studertts,  experts  in  the  subject  matter. 
Each  rater  hiad  three  sets  of  c|uestions  and  thr^e  presentations  to 
review: .  v  , ;  c 

The  raters.^first  judged  the -"presence"  of  ea^h  question's 
content  ih^  the  source  presentation(s)  using  a  3-pbint  scale.  The 
conteht  could  be  explicitly  present  (3),  implicitly  present  (2) ,  or 
not  present  at  all  (1).    Raters  wejre  ins^tructed  to  spend  ^t  more 
than  a  coupl^  of  minutes  searching  for  particular  contents.  The 
modal  rating' of  the  seven  rating /Was  assigned  to  the  question  to 
determine  whether  it  was  explifcitly  or  implicitly  stated  in  the  4 
instructional  discourse.    The  majority  of  literal  questions  (29) 
contained  explicitly  stated  content;  only  8  questions  asked  about 
implicitly  stated  content. ^  ^  ■ 

For  tThose  questions  rated  as  present  (received  a  "2"  or  "3")/,. 
the  raters  next  e\/aluated  the  relative  importance  of  the  question's 
cohtent.    Raters  were  given  these  instructions:    '*This  rating 
should  pertain  only  to  how  the  material  wa$    pr(^sented--how  important 
did  the  author  intend  this  content  to  be?   Try  not  to  be  influenced 
by  how  important. you  Ijhink  it  should^ h^ve  been  presented."    A  5-point 
scale  for  importance  was  used  with  "1"  being  "very  unimportant",  and. 
'•5"  being  "very  important." ,  A  "3"  represented  the  neutral  choice 
of  "can't  decide."    The  mean  importance  rating  of  the  seven  ratings 
was  assi§ned  to  each  literal  question.    This  resulted  in  only  two 
groups  of  questions:    14  very  important  questions  and  23  important  ^ 
^  questions.    No  question  received  a  mean  rating  less. than  "3". 

.Because  the  importance  ratings  assumed  great  signiftcahce  in 
,  subsequent  data  analyses,  a  check  on  their  external  validity  was 
also  made.    A  measure  of  the  level  of  embeddedness  of  each 
question's  content  was  determined  by  examination  of  the  mapped 
concepts  and  relationships  from  which  the  question  was  originally 
drawn.    A  higher  number  of  levels  signified  greater  embeddedness; 
that  is,  a  more,  subordinate  concept  in  the  discourse.  ^The  mean 


level  of  embeddedness  was  calculated  for  questions  designated  as  "very 
important,"     =  2.036,  SD  =  1.046,  and  fof*  questions  designated  as 
"Important,"  1  =  3.369," SO  =  .'991.    A  t-test  for  the  difference  . 
between  the  two  means  'resulted  in  a  statistically  significant  difference 
t(36)  =  3.886,  £_ <.001 ,  which  corroborated  the  empirical  designations 
of  importance  provided  by  the  raters. 

The  relationship  type  of  each  question  was  determined  by  analyzing 
the  wording  of  1?he  question  in  terms  of  the  recognized  relationship 
types.  ^  / 

Data  Collection  Procedure  ^  , 

Data  collection  took  place  over  a  span  of  three  weeks  early  in  the 
the  semester.    During  this  time  the  topic  igneous  rocks  was  covered 
in  lecture  and  laboratory  sessions  of  the  geology  course.  Questions 
about  the  instructional  presentations  were  distributed! over'threef 
quizzes,- one  following  each  presentation,.    Quiz  1  contained  only^ 
questions  drawn  from  the  textbook.    Quiz  2  contained  questions  based 
on  both  textbook  and  lecture  presentations.    Quiz  3  drew  on  all 
presentations  and  included  the  six  transfer  questions.  Because 
students  had  more  knowledge  available  to  integrate  as  instruction^ 
progressed,  the  proportion  o-f  integration  questions  increased  with 
each  testing. 

Quiz  1  and  Quiz  3  wgre  administered  in^|teecture  sessions. 
All  students,  regardless  of  their  particil^PTon  in  the  study,  took 
the  quizzes  .because  a  portion  of  each  was  counted  toward  course 
credit.    Quiz  2  was  administered  in  the  laboratory  classroom.  Half 
the  students  in  this  quiz  event  received  an  unrelated  vocabulary 
quiz.    This  was  done  in  order  to  check  for  possible  test  effects 
due  to  the  repeated  testing  of  students  during  the  study. 

Attached  to  the  second  Quiz  (both  Qu,iz  2  and  the  Vocabulary^ 
Quiz)  was  a  page  describing  what  students  should  expect  on  the  final 
quiz  and  how  they  might  approach  studying  for  it.    These  "t^sks 
instructions"  were  presented  in  two  versions,  distributed  randomly 
to  approximately  equal  numbe^of  ^tudents .    The  "no  integration" 
version  instructed  stiidehts  that  Quiz  3  would  cover  all  three 
presentations  on  igneous  rocks  and  to  "study  as  you  normally  would." 


In  the  "Integration"  version  students  aUo  were  told  that  all  three 
presentattpns  would  be  covered;  but  they  were  told  that  the  questions 
would  be  quite  different  from  previous  quizzes.    The  instructions^ 
stated  that  students  would  be/asked  to  "synthesize  information  from 
these  various  Sources  and  to  solve  problems  using  this  information." 
They  were  explicitly  urged  to"  "try  to  think  how  information  from  each 
source  relates  to  information  from  other  sources." 
Data  Analysis  Procedures  and  Preliminary  Analyses  v. 

With  the  exception  of  the  factor  of  task  instructioYis,  all  of 
the  independent*^ variables  o*^  interest  in  this  research  were  witl>in- 
subjects  factors.    The  dependent  measures  in  each  analysis  were'tlie 
proportions  of  questions'  that  students  correctly  answered  within 
specified  subsets  of  questions.   The  proportion  scores  were  J 
transformed  into  arcsih  values  for  use  in-ANOVAS. 

Effects  of  a  number  of  potentially  confounding  factors  were 
assessed  prior  to  analyzing  data  which  addressed  the  research  . 
questions.    These  results  and  their  implications  are  reviewed  here 
briefly.  >  ,       ^  ■ 

(1)  CronbacK's  alphci-coefficients  of  reliability  were 
determined  for  the  three  quizzes:    Quiz  1,^  .61  (n^  =  271);  Quiz  2, 

.>62  (n  =  127);  and  Quiz  3  .58  (ri  =  253).    Reliabilities  for  multiple- 
choice  tests  typically  administered  .in  the  course  over  a^three-year 
period  averaged  .74.    Given  the  diversity  of  question  types  asked 
in  the  study 's  quizzes ,  the  quiz  data  were  deemed  sufficiently 
reliable. 

(2)  Students  attended  one  of  two  lecture  sessions  and  one  of ^ 
thirteen- laboratory  sessions.  Potential  differences  in  performance 
due  to  instructional  variation  were  tested  by  comparing  a  number 

of  composite  quiz  scores.    No  consistent  differences  among  the 
groups  were  confirmed  statistically. 

(3)  Mean  scores  on  Quiz  3  were  compared  between  those  students 
who  took  Quiz  2  and  those  who  took ^the  unrelated  quiz.    The  two 
groups  did  not  differ  statistically  on  their  total  final  quiz  score 
or  thetr  subscores  on  literal,  integration,  or  transfer  questions 
from  the  final  quiz.    Test  effects,  therefore,  were  ruled  out  as  a 
potentially  confounding  factor. 


.,  Results " 

CriticaJ  tasks:   Qitestion  Types 

The  percentages  of  questions  that  students  correctly  answered 
in  each  catgory— 1  iteral  .^i ntegrati on,  and  transfer— were  calculated 
for  all  the  quizzes  combined.  '.Students'  scores  for  the  three  types 
of  questions  differed  significantly,  F(2, 232)  =  44.59,  p<'.001.  The 
Newman-Keuls  method  of  post-hoc  comparisons  revealed  that  students 
performed  significantly  better  on  the  literal,  questions  taken  as  a 
group  (X  =  70.6),  than  they  did  on  the  knowledge  integration 
questions  (X  *  56.5),  and  the  transfer  questions  (X  -  53.9). 
Students'  performance  on  the  latter  two  types  of  questions  did  not 
differ  significantly. 
Nature  of  Materials:    Content  Structures 

Content-match.    Students'-  percentage  scores  on  the  18, content- 
same  literal  questions  were  compared  to  their  "scores  on.  the  19 
content-different  questions.    Students  correctly  answered  a  greater 
proportion  of  content-same  qxie^tions  \(f  =  74.5)  than  content- 
different  questions  (X  =  68.7),  F(l,232)  =  8.23,  £<  .01. 

Importance  and  expl icitness.  .  A  2  x  2  ANOVA  for  repeated 
measures  was  used  to  assess  students'  performdtice  Qn  literal 
questions  which  were  grouped  by  two  levels  of  importance  (very 
important  versus  important)  and  two  categories  of  expl icitness 
(explicit  versus  implicit).    The  mean  proportions  of  correctly 
answered  questions  and  th6  numbers  of  questions  for  each  group  are 

sho^m  in  Table  5.3.  '  .  ^  r 

Neither  the  main  effect  for  explicitness  or  importance  of  the 
questions  reached  statistical  significance,  although  the  effect  for 
explicitness  approached  significance  (£  =  .078).    The  interaction 
effect  was  disordinal  and  statistically  significant  .^^(1 ,116)  =  5.87, 
p  <.05.    When  simple  main  effects  were  analyzed,  students'  superior 
performance  on  explicit/important  questions  accounted  for  the 
-differences  observed.    For  questions.^lassed  as  e)^plicit,  students 
performed  better  on  questions  which  were  fated  important  than  those 
rated  very  important,  F(l ,232)  =  4.63,  2.<.05.    For  que'^tions  classed 
as  implicit,  importance  did  "not  differentiate  students'  scores. 
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TABLE  5-3 
Scores  on  Literal  Questions 
Grouped  by  Importance  and  Explicitness 


Question  Group 

X% 

#  of  questions 

Very  Important 

Explicit 

69-3 

10 

Impl icit 

71.0 

4 

Important 

Explicit 

75.6 

19 

Implicit 

67.5 

4 

TABLE  5.4 
^     Scores  on  Literal' Questions 
Grouped  by  Importance  and  Relationship  Type 


Question  Group 

x% 

#  of  questions 

Very  Important 

Dfefault 

70.3 

■  7 

Distinct 

68.5 

7 

Important 

Default 

72.6 

13 

Distinct 

76.6 

10 

1. 
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For  the  very  important  questions,  students*  scores  did  not  vary  by 
the  explicitness  of  the  questions'  contents.    Among  important 
questions,  however,  students  answered  correctly  a  greater  proportion 
of  explicit  questions  than  implicit  questions,  £(1,323)  ^*^8.48,  p<\01. 

Importance  and  relationship  type.    The  Influence  of  importance 
and  relationship  type  of  question  content  on  students'  performance 
was  analyzed  in  the  same  manner  as  that  described  for  importance  and 
explicitness.    In  this  analysis,  the  literal  questions  were  grouped 
by  the  two  levels  of  importance  and  two  groupings  of  type  of  rela- 
tionships (default:  property  and  example  versus  distinct:  definition, 
comparative, .temporal  and  causal).    The  mean  proportions  and  numbers 
of  questions  in  each  group  are  displayed  in  Table  5.4. 

A  significant  main  effect  was  observed  for  importance  level, 
F(l,116)  =  13.77,  p<. 001.;  but  not  for  relationship  type.  The 
interaction  of  the  factors  was  significant,  £(1,116)  =  5/32,  p<  .05. 
The  main  effect  for  Irriportance  held  only  for  questions  containing 
distinct  relationship  types—definitions,  comparisons,  or  process 
relationships.    For  these  questions,  students  performed  better  on 
important  questions  than  on  very  important  questions,  F(l,232)  =  17.96, 
p,<  .001 

Among  the^^estions  rated  as  important,  students  performed 
better  on  distinct  questions  than  they  did  on  default  questions, 
£(1,232)  =  4.10,  p<  .05.  '  Among  questions  rated  as  very  important, 
no  statistically  significant  difference  in  scores  due  to  relation- 
ship.type  was  observed.    Students'  superior  scores  on  important/., 
distinct  questions  accounted  for  the  significant  contrasts  which 
were  found. 

Learning  Activities:    Task  Instructions 

Performance  data  from  Quiz  3  were  used  in  a  2  x  3  ANOVA,  where 
test-question  type  was  a  wi thin-subjects  factor  with  three,  categories 
(literal,  integration,  and  transfer)  and  task  instructions  was  a 
between-subjects  factor  with  two  groups  (integration  and  no-integra- 
tion).   The  percentages  of  questions  correctly  answered  in  each 
category 'from  Quiz  3  were  compared  for  the  two  groujfs  of  students  * 
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A  significant -fliain  effect  was  observed  only  for  question  type, 
F(2,448)  =  153.16,  p<  .001.  Students  performed  significantly  better 
on  literal  questions  (X  =  87.5)  than  on  integration  and  transfer 
questions;  and  performed  better  on  Integration  questions  (X  =  72.6) 
than  on  transfer  questions  (X  =  54.6).  Neither  the  main  effect  for 
task  instructions  nor  the  interation  proved  to  have  a  statistically 
significant  effect  on  scores  from  Quiz  3. 

Discussion  ,  , 

When  quizzed  on  information  derived  from  three  instructional 
presentations  of  the  same  general  topic,  students  in  a  large  - 
introductory  geology  class  performed  best  on  questions  of  literal 
knowledge  and  performed  poorly  on  questions  involving  integration 
or  transfer  of  knowledge.    Literal  questions  represented  low-level 
questions,  presumably  requiring  only  retrieval  of  factual  information 
(Andre,  1979).    The  students'  superior  performance  on  this  type  of 
question  probably  comes  as  no  surprise  to  college  instructors  who 
are  aware  that  students  typically  encounter  low-level,  multiple-  ' 
choice  questions  on  exams  in  large  classes. 

The  students'  performance  on  literal  questions  was  further 
analyzed  in  terms  of  a  number  of  features  derived  from  the  content 
structures  of  the  instructional  presentations.  Students  responded 
with  proportionately   more  correct  answers  to  questions  drawn  from 
content-same  topics  than  to  those  drawn  from  content-different 
topics.    Because  both  content-same  and  content-different  topics 
were  metitioned  in  two  or  more  instructional  discourses,  mere 
repetition  of  topic  cannot  account  for  the  observed  difference  in 
performance.    Rather,  it  is  suggested  that  repetition  of  the 
informattonal  context  of  the  topics  facilitated  acquisition  and 
recollection  of  content-same  information.    Presentation  of  content- 
same  information  across  related  instructional  discourses  may 
contribute  to  "instructional  coherence"  in  the  same  way  that  use  of 
identical  terms  or  similar  context  maintains  "referential  coherence" 
in  brief  passages  (Kintsch  &  Vipond,  1979;  Walker  &  Meyer,  1980). 

Importance,  expl icitness ,  and  relationship  type  interacted  to 
influence  students'  performance  on  literal  questions.    For  the 
.    particular  materials  of  this  study,  students  performed  better  on 
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literal  questions  whose  contents  were  rated  Important  when  the 
contents  were  also  explicitly  stated  In  an  instructional  discourse, 
or  when  the  questlbns'  contents  involved  a  distinct  relationship  ■ 
type.    Questions  about  very  important  content  appeared  to  have  been 
equally  diiFficult  to  answer  regardless  of  other  text-derived       *  * 
characteristics. 

By  contrast,  students  generally  performed  less  well  on  very 
Important  questions  which  asked  ?bout  summations  or  high-level 
generalities  from  the  instructional  discourses.    This  finding  runs 
counter  to'the  conclusions  of  most  research  on  the  role  of  Importance 
in  4liscourse  comprehension  (Johnson,  1970;  Kintsch  &  van  Dijk,  1978; 
Meyer,  1975,  1977).    Using  measures  of  free  recall,  these  researchers 
found  that  subjects  consistently  recalled  more  elements  high  in 
text  structure  than  low  in  text  structure. 

In  these  studies  elements  low  in  text  structure  generally 
corresponded  to  unimportant  or  trivial  details.    In  the  instructional 
research  reported  here,,  question  content  was  drawn  primarily  from 
elements  high  in  text  structure,  contrasting  Important  from  very 
Important  content,    bespite  methodological 'differences ,  however, 
both  discourse  comprehension  research  and  instructional  intuition 
would  predict  that  students  should  have  been  more  successful  on 
questions  about  very  Important  information  th'an  on, questions  about 
less  Important  information.    Two  lines  of  reasoning  are  proposed 
to  account  for  the  anomalous  findings  reported  here\. 

The  first  argument  assumes  that  students  learn  best  what  they 
regard  as  most  Important  in  both  experimental  passages  and  natural 
instructional  discourses.    The  question  is  how  did  students  determine 
what  was  most  Important.    The  students'  concept  of  importance-in- ' 
instruction  apparently  did  not  correspond  to  the  rater's  selection 
of  very  Important  content  in  the  instructional  discourses.  The 
raters'  notion  of  Importance  appeared  to  be  based  on  the  generality 
or  superordi nance  of  content  and  was  corroborated  by  the  mapping 
analysis.    This  usage  is  conceptually  consistent  with  importance- 
in-dis6ourse  as  determined  by  analysis  of  content  structures  in 
discourse  comprehension  research.    It  is  proposed  here  that  the 
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students'  notion  of  1mportance-1n-1nstruct1on  presumed  that  material 
which  was  most  likely  to  be  tested  was  most  Important  to  learn, 
^Students*  previous  test  experiences  may  have*  led  them  to  expect  - 
low-level  questions  about  specific  factual  Information,  and  they 
studied  accordingly. 

The  second  line  of  reasoning  assumes  that  students  did  not 
encode  preferentially  one  type  of  Information ^over  another.  Instead, 
their  poorer  performance  on  very  Important  questions  reflected  the 
slightly  greater  degree  of  cognitive  processing  required  to  answer 
such  questions  compared  to  specific  factual  question.    It  should  be 
remembered  that  the  very  Important  questions  were  not  high-level 
questions  In  the  sense  of  requiring  Integration  or  transfer  of 
knowledge  from  several  Instructional  discourses •    Their  content  was 
simply  more  Inclusive  and  general  than  the  content  of  Important 
literal  questions. 

The  only  attempt  In  this  study  to  Influence  students'  learning 
behaviors  was  the  provision  of  two  versions  of  task  Instructions 
prior  to  Quiz  3,  the  final  quiz.    It  was  hoped  that  students  receiving 
the  Integration  Instructions  would  alter  their  customary  expectation 
of  low-level  test  questions  and,  consequently.  Improve  their 
performance  on  questions  requiring  Integration  or  transfer  of  know- 
ledge.   The  results  emphatically  demonstrated  no  effect  due  to  the 
task  Instructions.  v 

Any  number  of  events  may  have  mediated  between  students'  receipt 
of  the  Instructions  and  their  test  performance.    Students  may  not 
have  read  or  understood  the  Instructions;  they  may  have  forgotten 
about  them  when  they  studied.    They  also  may  not  have  known  how  to 
study  for  questions  which  required  them  to  tie  together  and  apply 
related  Information.    In  any  case  the  task  Instructions,  presented 
only  once,  were  not  powerful  enough  to  Influence  Teaming  activities 
which  might  have  Improved  students'  performance.    This  Is  not  to 
say  that  task  instructions  In  general  are  useless;  but,  the 
particular  statement  and  delivery  of  Instructions  In  this  study 
were  not  sufficient  to  affect  learning  oi(tcomes. 
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Implications 

Thus,  It  was  found  that  students  In  a  fairly  typical  college 
science  class  were  shown  to  perform  poorly  on  questions  requiring 
higher  level  cognitive  processes  (integration  and  transfer).  This 
result  should  not  be  attributed  solely  to  the  students'  "lack  of 
cognitive  skills"  or  to  any  "Inadequacy"  of  the  instructional 
"treatment."    Rather,  the  interaction  of  many  factors  in  a  complex 
instructional  setting  likely  produced  the  observed  outcomes.  For 
example,  the  nature  of  Instructional  discourses  was  shown  to  affect 
quiz  performances  in  a  predictable  manner.    Likewise,  students' 
expectations  of  the  criterial  task  Influenced  their  learning 
outcomes.    This  Influence  was  not  evidenced  by  the  task  instructions 
provided  to  students,  but  can  be  Inferred  from  the  interpretation 
6f  students'  superior  performance  on  specific  factual  questions 
which  are  typical  of  exams  in  large  college  courses. 

In  terms  of  Implications  to  the  practice  of  instruction,  these 
results    suggest  that  providing  students  with  many  opportunities  to 
Integrate  and  apply  new  knowledge  in  class  discussions  may  be  i 
counterproductive  if  testing  requires  only  low-level  knowledge  &c)d 
cognitive  skills.    Similarly,  Instructors  who  forewarn  students 
that  synthesis  of  knowledge  will  be  tested  should  not  be  surprised 
that  performance  is  poor  if  they  have  failed  to  provide  meaningful 

« 

learning  activities. 

Researchers  concerned  about  classroom  learning  outcomes  may 
also  benefit  from  acknowledging  the  real  complexity  of  instructional 
settings.    To  this  end  the,  methodological  tools  and  paradigm  of 
discourse  comprehension  research  proved  useful  in  describTVig  the 
content  structures' of  instructiohal  discourses  in  this  study. 
These  methads  can  and  should  allow  researchers  to  analyze  and 
describe  the  nature  of  instructional  "treatments"  more  fully- than 
has  been  the  practice  thus  far.  .  , 
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Given  that  certain  readers  have  difflocrtty  dealing  with 
certain  text  features.  there|has  been  a  tendency  for  researchers 
»to .subscribe  to  one  of  two  stands:    either  pursue  Instruction  that 
win  assist  readers  with  there  texts,  or  develop  text  In  such  a 
way  as  to  avoid  such  difficulties.    Robinson  (1961)  provides  a 
convincing  argument  In  support  of  the  former  stance.    He.  suggests 
that  while  textbooks  could  stand  Improvement,  students  given 
better  books  will  not  do  much  better  with,  them  unless  they  are 
taught  necessary  reading  skills  to  use  their  textbooks. 

At  the  present  time,  however,  resear({h  that  addresses  the 
domain  of  meeting  the  text-based  needs  of  readers  is  in  its 
infancy.    Instructional  studies^ntended  to  provide  students  with 
generalizable  strategies  fop^ealirg  more  effectively  with  text 
have  only  scratched  the  surface  with  respect  to  providing  educators 
guidelines  that  can  generalize  across  sites  (Tierney  and  , 
Cunn1ngham,M980).    mhough  studies  by  Bartlett  (1978),  Dansereau, 
Hoi  ley.  and  Collins  (1980),  and  Geva  (1980)  have  provided  pronHsing 
data  supporting  the  transfer  value  of  training  in  text-based  / 
strategies i  most  researchers  Involved  with  instructional  interven- 
tions have  had  little  success.    Even  those  researchers  we  have 
cited  would  probably  agree  that  they  have  achieved  relatively  little 
'gain  for  the  instructional  energy  that  was  expended.    At  this  time, 
detailed  analyses  of  Instructional  success  and  failure  are  lacking. 
Consequently,  guidelines  for  educators  intent  on  meeting  the  needs 
of  students  to  deal  with  their  textbooks  are  more  speculative  than 
reasoned  from  a  data  base.  * 

With  this  in  mind,  we  present  two    separate  reports  of 
attempts  to  develop  means  of  helping  students  learn  from  their 
textbooks.    The  studies  are  by  no  means  significantly  rem^^ed 
from  the  studies  we  cited  above  in  problems  inherent  in  their 
instructional  design.    Like  much  of  the  previous  work  testing  the 
'effectiveness  of  strategy  Instruction,  o|r  studies  are  also*m(J^e  , 
Intuitively  derived  than  theoretically  prescribed.    Still,  we 
believe  they  represent  a  beginning  that  will  Inform  futyre  attempts 
at  identifying  ways  of  helping  students  help  themselves  learn 
from  their  textbooks. 
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PART  1:.    MAPPING  AS  AN  AID  IN  HELPING  STUDENTS 
LEARN  FROM  THEIR  TEXTBOOKS 
Diane  L.  Schallert  Ernest  T.  Goetz 

Michael  C.  Murph'y  Robert  J.  Tierney 

In  the  previolis  sections,  we  have  reported  how  students 
typjcally  perform  when  they  encounter  Instructional  discourse.  In 
most  of  the  studi^es,  we  attempted  to  observe  naturany-occurring  texts 
being  learned  in  as  t)6pical  a  way  as  we  could  arrange  within  experi- 
mental  constraints.    Hisre  vyfe  report  on  our  attempts  at  training 
students  to  improve  their  strategies  for  dealing  with  their  textbooks. 
Since  oUr  earlier  findings  had  demonstrated  that  students  have  major^ 
difficulties^  learning  from  their  textbooks  and  in  particular,  under- 
standing the  connections  (or  relationship's)  between  ideas,  we  decided 
to  adopt  an  approach  stressing  the  structure  of  and  relationship 
between  concepts.    Mapping,  now  Considered  as  an  instructional  aid, 
became  an  obvious  choice. 

The  general  plan,  then,  of  this  study  was  to  train  orie  VouP 
of  students  in  mapping  samples  taken  from  textbooks  and  to  compare 
how  well  theAperformed  on  subsequent  learning  measures  with  the^ 
performance  of  a  control  group  of  students  not  receiving  instruction. 

' :  Method 

Subjects 

One  criterion  for  Identifying  an  appropriate  population  for 
this  stJdy  was  that  the  students  be  available  for  a  fairly  intensive 
course  of  training  and  that  the  training  be  perceived  by  the  students 
as  appropriate.    After  some  search,  our  choice  was  narrowed  down  to 
university"  freshmen  enrol  led  in  a  study  skills  improvement  class  at 
Texas  A&M  University.    The  course  was  organized  as  a  3-hour,  10- 
section  course  Intended  for  students  wh.o  were  either  on  academic 
prob*ation,  hadf  had  general ly  low  entrance  scores,  or  wjio  felt  they 
wanted  to  improve  their  current  met-hods  tff  studying.    We  began  with 
approximately  110  students,  90  of  whom  completed  all  phases  of  the 
study.  ,  ' 
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Design  -..^        ^  ^  ^ 

The  major  variable  (of  interest  was  that  of  training.  Students 
taking  the  study-skills  coursjE  on  Mondays ,  Wednesdays,  and  Fridays 
(6  sections)  were  assigned  to'^^the  treatment  group  (n=53).  TheXfour 
Tuesday-Thursday  sections,  became  thie  no-treatment  control  group. 
These  students  (n=37)  received  no  special  instruction  between  the 
pretest  and  posttest  sessions  but  attended  their  regularly  scheduled 
class  and  instructor.  - 

All  participants  received  a  specially  designed  pretest  and  post- 
test  that  served  as  the  measure  of  effectiveness  of  our  training.  At 
each  testing  session,  two  texts  were  presented,  followed  by  free 
recall  tasks  an^d  short-answer  ^tests .    In  contrast  to  the  first  text, 
students  received  directions  to  read  and  learn  the  second  text  using 
some  form  of  notetaking.    At  pretest",  this  was  specified  as  outl ining 
for  all  students.    At  posttest,  the  mapping  trained  subjects  were 
asked  tt)  map  the  text  while  the.  cont^-ol  subjects  were  again  asked  to 
outline.    At  each  test  session,    one  of  the  texts  was  a  History  text 
and  one  was  a  Biology  text,  the  order  of  topics  being  counterbalanced 
across"  subjects .    One  final  variable  appeared  in  the  design  in  the 
form  of  text  type.    Half  of  the  students  in  each  of  the  training 
conditions  received  at  test  time  "process"' texts  involving. many 
temporal  and/or  causal  relationships,  and  half  received  "descriptive" 
texts  involving  mostly  properties  and  examples. 
Treatment  Procedure 

At  the  first  meeting  the  pretest  was  administered  to  all 
participants.    Students, in  the  control Iqroups  returned  to  their 
•^regular  schedule  and  instructors  for  twoXmore  class  meetings.  They, 
then  received  the  posttest  on  the  fourth  class  day  after  the 
beginning  of  the  experiment. 

following  the  pretest  session,  students  in  the  MWF  sections 
of  the  cfourse  began  training  in  mapping  as  a  study  strategy.    On  the 
first  day  students  were  introduced  to  mapping— what  it  is,  how  it 
relates  to  other  study/notQtaking  strategies,  what  is  can  do  for 
a  learner.    The^main  relationships  used  in  mapping  (property, 
d^inition,  example,  comparatives,  temporal  and  causal)  were  * 


Introduced  in  a  workbook  format  that  students  referred  to  as  an 
instructor  explained  to  the  class  as  a  whole.    The  students  were 
then  giv.en  exercises  to  practi^  the/Strategy.    While  they,,  worked 
on  these:tlass  exercises^three  instructors  privately  checked  their 
work,  and  gave  fyjp^ther^clarif ication  and  feedback  as  needed.  A 
homework  assfgnment  was  handed^ out.  .  .  ' 

^-^OrTo^y  two,  the  relationships  and  symbols  emphasized  by  mapping 
"were  reviewed  and  the  concept  of  embedding ^the  symbols  to  describe 
more  than  one  relationships  at  a  time,  and  more  than  <?ne  clause  or 
senterice,  was  introduced.^  Students  again  completed  in-clas/s 
exercises  and  received-  an  assignment  to  practice  vfhat  they  had 
learned  after  class.    On  Day  three  of  training,  students  rec^iyed 
more  experience  with  even  longer  (100  to  200  word)  passages. 
Testing  Procedure 

Materials.    As  outlined  above,  there  were  two  test  sessions, 
a  pretest  and  a  posttest  session.  -  At  each* session ,    each  student 
received  two  texts  and  their  associated  measures.    The  texts  were 
chosen  from  our  original  sample  excerpted  from  high  school  level 
Biology  and  History  textbooks  (see  Section  III  and  Appendix  D).- 
'students  received  either  all  process  texts  (2  Histo'r^^:  #223  and  228; 
2  Biology:  #101  and  112)  or  all  descriptive  texts  f2. History:  #226 
and  227;  2  Biology:  #  103  and  111). 

Short-answer  questions  were  developed  using  the  relationship 
proposition  lists  as  a  base.    For  each  text,  there  were  two 
questions  that  tested  ideas  coming  from  high  level/explicit 
propositions  (see  Section  III. 2  and    III. 3  for  operational izati on 
•  of  level  and  expl icitness) ,  two  questions  for  high  level/expl Icit 
and  two  for  low  level/lmpl 1c1t  Ideas.'  An  example  of  a  high  level/ 
explicit  question  derived  from  Text  #101  is,  "When  is  the  tadpole 
considered  a  young  frog?"    An  example  of,  a  low  level /implicit 
question  from  the  same  text  is,  "How  are  the  lungs  formed?" 

Sequence  of  tests.    At  each  test  session,  the  students 
received  two  envelopes.    They  were  instructed  to  empty  the  first 
envelope  and  to  begin  reading  through  the  materials  exactly  in 
the  order  presented.    As  they  ffnished  each  task  they  put  It  in  the 
envelope.    The  sequence  for  each  text  was:    (l)'an  instruction 
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sheet  asking  them  to  read  and  learn  the  following  text  as  well  ^as 
they  can  for  as  long  as  they  need  (up  to  TO  minutes)*  to  understand 
it  welt;  (2)  the  text;  (3)  a  metacognitive  rating  scale  asking  them 
to  decide  how  well  they  understood  the  passage  just  read  (l="not 
very  well  at  all",  4="very  well ") ;  (4)  free  recall  instructions 
asking  them  to  write  down  in  as  much  detail  as  ppssible  all  they 
remembered  of  the  text;  (5)  the  8-question  short-answer  test.    Once  - 
the  students  ^ad  finished  the  first  packet,  they  emptied  the  second" 
envelope  and  followed  the  same  sequence.    The  one  deviation  from  the 
procedure  f or""  the  first  text  was  that,  as  part  of  the  instruction 
to  Vead  and  learn  the  text,  the  students  were  told  to  outline  a's 
they  read  (or  to  map  for  the  mapping  group  on  the  posttest)  using. a 
blank  sheet  provided  in  the  booklet.    Both  testing  sessions  typically 
took ^40  minutes  each,  although  a  few  students  needed  the  full  50 
minutes  of  a  class  session.  - 

Results 

Recal 1  '  ^ 

Students'  responses  to  the  free  recall  task  were  scored  using 
the  same  procedures  described  in  Section  III. 3.  For  purposes  of  a 
preliminary  look  at  the  .data,  only  scores  reflecting  students' 
control  of  each  whole  proposition  (ALLS)  and  of  just  the  relation- 
ships part  were  analyzed.    Al^^r  only  the  scores  from  students  in 
both  training  conditioji  receiving  the  process  type  of  text  were 
analyzed,  reducing  the  N  to  43  for  recall  data  only. 

We  tested  the  effects  of  training  and  of  the  different  test  .- 
points  (pretest  1 ,  pretest  2,  posttest  1  and  posttest  2)  and  formed 
no   significant  differences  among  the  means.    The  gen5'^al  level  of 
recall  was  .30  for  the  whole  proposition  scores  and  .34  for  the 
relationship  part.    For  both  scores,  the  lowest  mean  was  registered 
for  thQi^flrt^pping  trained  group  responding,  to  the  second  text  on 
the  pofttest,  the  teyt  where,  the  students  were  asJced  tq  use  their 
newly  learned  strategy  as  they  read. 

There  was  a  significant  order  by  test  point  interaction 
attributable  to  the  depressed  performance  of  any  sub-group  when  . 
learning  Text  #223,  The  New  Deal  Farm  Program. 

..        •  '  I 
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Metacognition  Rating 

The  responses  to  the  metacognition  rating,  1  =  not  very  well 
(understood),  4  =  very  well  (understood)  were  submitted  to  a  four- 
way  analysis  of  variance  with  training  condition  (mapping,  control) 
text  type  (process ,  descriptive)  test  point  (pretest,  posttest)  and 
text  within  test  point  (text  1,  text  2     generate  outline  or  map 
y/hile  learning). 

;      Results  indicated  that  on  the  whole  students  were  fairly 
confident  they  had  understood  the  texts  (Grand  X  =3.04).  There 
was  a  significant  difference  between  the  two  test  points,  with 
ratings  obtained  at  the  pretest  significantly  higher      =  3.23)  than  J] 
ratings  obtained  a(t  posttest  (X  =  2.85),  F(l,86)  =  40.05,  p<  .001. 
Also  within  test  session,  students  generally  felt  more  confident 
on  the  first  text  (X  ^3.19)  than  on  the  second  (X  =  2.89),  F(l,86)= 
15.32,  p<.001.    This  is  interesting,  and  perhaps  puzzling,  given 
that  the  students  worked  harder  at  understanding  the  second  text. 

There  was  a  significant  two-way  interaction  between  training 
condition  and  test  point,  F(l,86)  =  10.36,  p  <.002,  subsumed  by  a 
significant  three-way  interaction  between  training  condition;  text/type 
type  and  test  point,  F(l,86)  =9.32,  p<  .003.    The  interaction  could 
be  attributed  to  the  fact  that  students  trained  in  mapping  receiving 
process,  texts  maintained  their  initial  level^^^d^elf  evaluation 
from  pretest  ()(  =  3;02)  to  posttest  (X  =  3.04)  whereas  the  mapping 
trained  group  receiving  descriptive  text  showed  a  noticeable  drop 
from  pretest  (X  =  3.12)  to  posttest  (X  =  2.72).    Students  in  the. 
control  group  generally  began  with  higher  estimates  at  protest, 
with  the  ratings  of  those  receiving  process  texts  particularly  high 
(X  =3.50)  then  dropping  precipitiously  (X  =  2.76).    For  the  control 
group  reading  descritpive' texts ,  the  means  were  3.28^at  pretest  and 
2.86  at  poSttest.   Thus  in  the  face  of  a  general  reduction  of 
confidence      their  ability  to  understand,  only  students  trained  in 
mapping  receiving  .process  texts  maintained  their  original  estimate. 
Short-Answer  Test 

Students'  responses  to  the  short-answer  tests  were  scored  on 
a\wo-point  scale,' with  scores  of  '7*^  assigned  to  complete  and 


correct  answer,  "T'  to  partially  correct  answers,  and  "0'*  to  incorrect 
answers  or  no  response.    The  highest  possible  score  on  any  one  test 
was  16.  ' 

Scores  were  submitted  to  a  four-way  analysis  of  variance  with 
the  same  factors  described  for  metacognition  ratings.  Students 
generally  performed  well  on  this  measure.    The  grand  mean  was  10.67, 
or  better  than  66%  of  the  total  possible  score.    However,  no  ' 
significant  differences  between  conditions  emerged.    The  means  for 
the  treatment  conditions  fell  slightly  in  favor  of  the  control  group 
and  pretest  scores  were  slightly  higher  than  posttest  scores, 
y  Discussion 

We  were  generally  disappointed  in  the  results  of  this  experiment. 
Although  students  seemed  to  be  learning  the  mapping  strategy  during 
training,  they  did  not  benefit  from  training  when  tested  immediately 
after  it  ended.    Perhaps  the  strategy  had  not  been  learned  well 
enough  to  bethel pful  to  the  students.    In  fact  evidence  that  mapping 
interfered  with  performance  is  indicated  by  the  fact  that  it  took 
twice  as  long  for  ^tud^nts  to  learn  the  text  when  mapping  as  compared 
to  when  outlining.    Yjet  performance  did  not  improve. 

Another'possible  factor  is  that,  for  the  population  represented 
in  this  experiment,  other  factors  besides  ability  to  relate  the 
ideas  within  a  text  may  have  a  greater  effect  on  performance.  Such 
factors  as  motivation,  text  anxiety ,  writing  ability  may  serve  to 
mask  the-  potential  of  training  in  a  strategy  that  is  concentrated 
on  attacking  the  text  language.    Indeed,  effective  study  skills 
programs,  such  as  those  of  Don  Dansereaa  and  Claire  Weinstein, 
include  a  large  tompopent  devoted  to  affective  re-training. 

Finally,  It  may  have  been  naive  to  expect  that  training  that 

lasts  a  total  of  three  class  periods,  that*  is  administered  by 

outsidefrs  and  not  explicitly  reinforced  by  the  students'  own 

teachers,  and  that  requires  a  relatively  intense  and  effortful 

processing  of  text  would  show  a  significant  effect  on  an  immediate 

posttest.    For  all  these  reasons ,  we  are,  not  willing  to  ''scrap" 

mapping  as  a  study  strategy  to  be  uTed  by  advanced  students.  How- 

ever,  we  do  feel  that  the  next  test  of  the  strategy  needs  to  be 

*  ff        *  ' 

more  thoughtfully  planned. 


PART  2:    USING  TOPIC/SUBTOPICS  AS  A  STRATEGY 
FOR  IMPROVING  STUDENT'S  TEXT  COMPREHENSION 
Karen  Margolis  Samson 
Previous  analyses  of  aspects  of  incoherence  in  biology  texts 
suggested  that  many  informational  texts  lack  a  carefully-developed, 
integrated  sense  of  continuity.    What  was  found  indeed  was  discon- 
tinuity, frequent  interruptions  in  the  flow  of  discourse.  Abrupt 
topic  shifts  most  often  contributed  to  the  discontinuity  of  these 
texts.    Such  interruptions  may  cause  some  readers  to  have  problems 
comprehending  the  gist  or  main  ideas  of  the  text.    In  an  attempt  to 
help  reati^s  become  better  able  to  cope  with  text  discontinuity, 
an  explicit  instructional  strategy  was  developed..    The  Topic/ 
Subtopic  strategy  emerged  as  a  practical  tool  Tor  helfting  readers 
identify  topic  shifts  and  discriminate  between  more  important  and 
less  important  ideas  represented  in  expository  text. 

A  two-week  instructional  study  was  conducted  in  which  high 
school  biology  students  were  taught  to  use  the  strategy.  The 
purpose 'of  the  study  was  to  examine  the  extent  to  which  this 
instructional  intervention  improved  readers'  comprehension  of  main 
ideas  reprefsented  in  their  biology  text. 

The  Topic/Subtopic  strategy  is  a  two-step  procedure  designed 
to  enab>e  readers  to  recognize  relationships  among  key  ideas  in 
text  by  engaging  readers  in  the  active  process  of  evaluating  and 
synthesizing  text  segments.    Stefp  One^of  the  strategy  involves 
readers  in  constructing  a  Topic  Comment  List  (T/C  List),  requiring 
them  to  analyze  sentences  in  terms  of  TOPIC  (what  the  sentence  is 
about)  and  COMMENT  (what  is  being  said  about  the  topic).    Step  Two 
involves  readers  in  grouping  Topic/Comment  elements  according  to 
relationship  types  in  order  to  create  important  subtopics  suggested 
by  relevant  information. 

The  Topic/Subtopic  strat^  is  a  means  of  channeling  readers' 
attention  to  relakonships  between  ideas  both  within  and  across 
sentences.    It  encourages  readers  to  activate  background  knowledge 
in  classifying  relationship  types  (i.e.,  example ✓  definition, 
property,  cause/effect,  similarity/difference.).    Since  the  goal 
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of  comprehension  in  classroom  situations  (especially  with  content- 
area  materials)  is  to  grasp  essential  ideas  or  gist,  the  Topic/ 
Subtopic  strategy  aims  at  developing  this  skill.    Like  mapping, 
flowcharting,  and  networking,  the  strategy  (Step  Two,  identification 
of  subtopics)  aims  at  providing  an  organized  summary  of  salient 
ideas  of  the  text.    The  advantage  of  this  strategy  is  that  it 
attempts  to  address  process  rather  than  product  aspects  of  text 
comprehension.    During  strategy  instruction,  readers  are  encouraged 
to  actively  participate  in  explicitly  evaluating  eaph  sentence  of 
the  text  in  terms  of:    type  of  content,  type  of  relationship  to 
other  ideas  in  the  text,  and  relative  importance  of  content  to 
other  ideas.    The  Topic/Subtopic  strategy  aims  at  helping  readers 
who  may  be  struggl ing  with  a  difficult  area  of  text;  unlike  the 
global  strateg'ies  of  mapping,  flowcharting,  and  networking,  it 
pT-ovides  explicit  instruction  in  prerequisite  tasks  such  as 
locating  important  ideas,  summarizing  and  condensing  information, 
and  discriminating  types  of  relationships. 

In  teaching  this  strategy,  I  was  interested  in  examining  the 
extentto  which  strategy  instruction  would  affect  readers' 
comprehension  of  gist  information.    Comprehension  of  gist  was 
measured  by  recall  and  short-answer  questions.    Three  experimental 
groups  participated  in  the  study:    Strategy  group,  Read-Study 
group  (who  practiced  reading,  studying,  then  recal.ling  ideas),  and 
the  Control  group  (who  had  no  experimenter  intervention). 

Based  on  the  premise  that  the  explicit,  direct  instruction 
offered  by  the  strategy  intervention  would  promote  learning  better 
than  mere  practice,  several  predictions  were  made.    First,  it  was 
predicted  that  the  explicit    strategy  instruction  would  result  in 
greater  recall  of  information,  than  would  the  practice  or  non- 
tredtment  conditions.    Second,  it  wgis  predicted  tha,t  the  recall  of 
subjects  given  strategy  instruction  would  contain  more  important 
ideas  than  that  of  the  practice  or  the  non-treatment  group.  Third, 
it  was  predicted  that  the  strategy  instruction  would  result  in 
higher  question  answer  Scores  than  either  the  practice  or  the- 
the  rion-treatment  group.  . 
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Method 

Subjects 

The  subjects  were  61  second  semester  high  schocfh  biology , 
students  in  a  rural  community,  approximately  26  miles  outside  of 
Champaign,  Illinois.    Intact  classroom  sections  were  assigned  to 
one  of  the  three  conditions  (Strategy,  Read-Study,  Control).  All 
subjects  were  voluntarily  enrolled  in  biology,  ill  had  been 
instructed  by  the  same  teacher  prior  to  the  experiment,  and  all  had 
been  taught  the  same  biology  curriculum.  » 
Testing  Materials  and  Schedule 

Throughout  the  experiment'  subjects  were  asked  to  read  each  of 
several  passage,  study  it  (or,  in  the  case  of  the  strategy  group, 
to  apply  the  strategy),  produce  written  recalls  of  all  information, 
rate  the  extent  to  which  each  passage's  content  was  familiar,  and  - 
then  answer  six  questions  about  the  content.    Four  test  passages 
were  se,lected  from  biology  texts  and  tradebooks.  Passages 
averaged  approximately  250  words,  with  Dale-Chall  readability 
rating  averaging  11.0.  "    ,  ' 

Short  answer  questions  to  accompany  each  passage  were  designed 
to  tap  subjects'  recall  of  both  explicit  and  implicit  relationships 
of  ideas.    These  were  constructed  from  an  experimenter-created 
T/C  List.    Attempts  were  made  to  construct  questions  whicJi  required 
subjects  to  synthesize  information  both  within  sentences  and. 
across  sentences. 

The  experimental  design  consisted  of  a  pre-test,  followed  by 
the  first  phase  of  the  instructional/practice  sessions  (4  days), 
then  a  mid-test,  followed  by  the  final  phase  of  the  instructional/ 
practice  sessions  (4  days),  then  two  post-tests,  and  finally  a 
delayed  (time  interval:    one  week)  post-test.    The  testing  and 
instructional  plan. is  summarized  in  Table  6. 
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Tables 

Summarization  of  Testing  and  Instructional  Plan 


Groups 

1 

2 

3 

4 

5 

6 

7 

Strategy 
n=21 

X 

Step  One 

X 

Step  Two 

XX 

X 

X 

Read-Study 
n=21 

X 

Practice 

X 

Practice 

XX 

X 

X 

Control  ' 
n=l9 

X 

X 

XX 

X 

X 

Key:    1  =  Biology  Pre-test  Passage! 
2  =  Instruction/practice 
3=  Mid-test  Biology  Passage  2 

4  =  Instruction/Practice 

5  =  Biology  post-test  Passage  3  and  History  post-test 
^  Passage  4  ^ 

6  =  Read  delayed  Biology  post-test  Passage  5 

7  =  Test  of  recall  and  questioris  for  Paissage  5 
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Scoring  Procedures 

Subjects'  recall  protocols  were  $cored  by  translating  them  . 
into  propositions,  then  comparing, them  to  the  template  text  base, 
and  classifying  them  into  types  of  recall  propositions.    To  capture 
differences  that  Kintsch  and  van  Dijk  (1978)  contend  represent 
'different  depths  of  processing,  recall  was  classified  into  the 
following  categories:    text  reproductions  (lower  level  of  processing), 
entailments  (higher  level  of  processing),  and  evocations  (higher 
level  of  processing),    these  three  types  of  protocol  propositions 
were  tabulated  for  each  subject's  recall  for  every  test  passage, 
with  an  interrater  agreement  of  .91  on  approximately  ^0%  of  the 
sample.    These  recall  scores  provided  theVaw  data  for  the  analysis  ; 
of  recal 1 .  * 

The  attempt  to  measure  main  ideas  or  gist  involved  a  comparison 
between  recall  protocols  and  those  text  base  propositions  identified 
as  most  important.    In  order  to  identify  what  may  be  judged  to  be 
'more  important  propositions  represented  in  the' text,  advanced 
biology  students  and  college  education  majors  were  Risked  to  rate  the 
text  in  levels  of  importance.    Propositions  were  later  ranked  by 
order  of  importance  based  on  these  evaluations.    The  topmost 
quarter  of  highly  important  propositions  were  determined  to  be 
"first  important  propositions."  A  more  global  measure,  that  of 
"secondary  important  propositions ,"  included'propositions  from  both 
the  first  and[  second  quarters  of  ranked  propositions.  Correspondences 
between  subjects>  recaU  protocols  and  importance  rankings  for  each 
set  of  propositions  were  examined  and  entered  into  the  statistical  analyses 

Answers  to  questions  were  scored  by  assigning  points  as 
follows:    2  points  for  completely  correct  answers,  1  point  for 
partially  correQt  answers,  0  points  for  t9tally  incorrect  or  blank 
answers.    Total'  question  scores  on  each  passage  provided  the  raw 
data  for  analyses  of  question  performance.    Interrater  agreement  on 
questions  was  .93  on  10%  of  the  sample. 

In  addition,  a  measure  of  familiarity  was  included  in  the  study. 
To  determine  the  extent  to  which  subjects  had  been  familiar  with  the 
passage  topic  prior  to  reading  the  passage,  subjects  were  asked  .to 
rate  their  level  of  familiarity  (5  =  yery  familiar,  4  =  familiar, 
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3  =  somewhat  familiar,  2  =  may  have  heard  this  once,  1  =  never  heard 
it  before).    Frequencies* of  each  dimension  were  considered  in  the 
analysis  of  each  passage. 
Instructional/Practice  Materials 

'  Passages  used  in  the  instructional  program  (and  for  practice 
with  the  Read-Study  group)  were  selected  from  the  classroom  text. 
Material  was  selected  with  two  criteria  in  mind.    First,  passages 
characterizing  particular  text  types  (descriptive  and  compare/ 
contrast)  were  chosen,  due  to  time  restrictions  -on  the  experiment." 
Second,  content  selections  (again  due  to  the  limited  time  framework) 
was  restricted  to  the  material  mandated  by  the  school  curriculum. 
•To  acconmodate  the  classroom  biology  teacher,  instructional  and 
practice  passages  used  in  this  study  were  selected  from  the  assigned 
chapter;  thus,  all  three  groups  in  the  study  covered  the  same  content 
during  the  experiment. 
Instructional  Program  «k. 

A  total  of  61  high  school  biology  studpnts  participated  in 
this  study.    The  Strategy  groups  and  Read-Stud^  were  each  composed 
of  21  subjects.    There  were  19  subjects  in  the  Control  group. 

Strategy  Group.    There  were  eight  25-40  minute  sessions  during 
which  the  strategy  instruction  was  implemented.    The  first  four  days  of 
instruction  were  devoted  to  introducing  the,  Topic/Subtopic  strategy- 
and  to  instructing  subjects  in  Step  One  of  the  strategy.  Subjects 
were  shown  a  model  of  the  entire  strategy  and  then  led  in  a  series 
of  modeled  practice  (with  discussion)  in  constructing  Topic/Comment 
Lists. ^  Types  of  relationships  (example,  definition,  property, 
cause/effect,  similarity/difference)  connecting  topics  and  comments 
were  discussed  and  identified  in  the  practice  materials.    Cues  in 
the  text 'for' determining  important  information  (e.0.  ,  first,  most 
of  all)  were  OAamined.    Two  passage  types,  descriptive  texts  and 
compAy^7^ptrastSta>ts\  were  used  as  instructional  materials.  The 
flexibility  of  constructing  a  T/C  List  was  emphasized  through  class 
discussion. 
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The  second' half  of  the  8-day  instructional  period,  was  devoted  * 
to  learning  Step  Two  of  the  strategy  and  to  providing  students  with 
some  practice  in  strategy  monitoring.    In  teaching  subjects  to 
create  appropriate  subtopics^  the  experiifenter  used  a  method  of 
modeled  practice,  feedback,  and  discussion,  like  that  used  to  teach. 
Step  One.    Much  attention  was  given  to  decisions  concerning  the 
general  relevancy  or  importance  of  various  comments.    Reasons,  behind^  • 
discrimination  of  important  and  unimportant  Subtopics  were  discussed 
in  detail.    Subjects  were  given  practice  in  applying  the  entire 
Topic/Subtopic  strategy  (Steps  One  and  Two).    In  an  attempt  to 
promote  transfer  of  the'  strategy  and  self-monitoring  of  strategy  , 
application,  excerpts  from  various  tradebooks ,. magazines ,  and 
assembly  manuals  were  included  as  part  of  .the  instructit)nal  materials^. 
These  were  intended  to  represent  a  variety  of  reading  material  for 
which  subjects  might  apply  the  Topic/Subtopic  strategy.  Examination 
of  these  materials  prompted  class  discussion  focusing  on  when  (and 
if)  usage  of  the  strategy  would  aid  comprehension.  ^ 

Read-Study  Group.    Subjects  in  the  ReadrStudy  group  received 
no  direct  instruction  in  any  strategy.    The  experimenter  met  with 
these  subjects  on  five  different  occasions.    During  the  sessions, 
subjects  received  biology  passages  identical  to  those  used  with 
the  Strategy  group.    Since  the  Strategy  group  used  a  total  of  /five 
different  passages  during  the  instructional  implementation,  it  was 
necessary  that  the  Read-Study  group  meet  only  f^ve  sessions.  These 
sessions  did  not  occur  consecutively ;  they  were  scheduled  around  the 
classroom  teacher's  curriculum  -plans .    With  these  practice  passages, 
subjects. practiced  reading  the  material,  studyjtig  it  for  a  maximum 
of  five  minutes,  and  then  recalling  all  they' could  rei^ember. 
Written  recalls  were"  collected  and  returned  the  following  day. 
Feedback  in  the  form  of  points  (5  maximum)  based  on  amount  of 
information  similar  to  the  original  passage  was' given.  These 
practi.ce  activities  took  a  total  of  15-20  minutes  per  session. 
Subjects  resumed  regular  classroom  Instruction  by.  the  biology.  ^ 
teacher  when  practice  activities  were  over  'and  on  days  when  no 
pract4ce  sessions^ occurred. 


6.15 


Control  Group.    Subjects  in  the  Control  group  continued  with 
regular  classroom  instruction  with  their  biology  teacher.  The 
experimenter  attended  these  sessions..  Regular  classroom 
activities,  included  lectures,  class  discussions,  independent  seat- 
work,  and  viewing  audiovisual  materials, 
Statistical  Analyses 

Hierarchical  multiple  regression  was  used  to  analyse  the  data. 
This  procedure  enabled  the  evaluation  of > the  unique,  effect  of  treat-  , 
ment  both  in  isolation  and  as  a  function  of  various  status  variables. 
Performance  on  pre-test  Passage  1  ^  reading  achievement,  biology 
scores,  familiarity,  and  treatment  served  as  predictor  variables  in 
the  regressions.    In  the  attempt  to  capture  greater  sensitivity  to 
gist  comprehension  measures,  two  sets  of  regressions  were  performed. 
Set  1  analyzed  data  from  the  following  dependent  measures:  text 
reproductions,  entailments,  evocations,  and. question  scores.    Set  2 
analyzed  data  from  the  following  (Jependent  measures:  first 
important  propositions,  secondary  important  propositioVis ,  and  total 
propositions.    All  two-way  interactions  and  only  those  three-way. 
interactions  of  interest  were  included. 

Those  variables  (reading  ability  and  biology  score)  that 
determined  the  extent  to  which  certain  basic  abilities  accounted 
for  the  variance  associated  with  the  comprehension  measures  were 
entered  first  into  the  equation.    Next  entered  were  variables  that 
determined  the  extent  to  which  performance  prior  to  the  instructional 
period  was  associated  with  the  coipprehension  measures  of  the  study. 
These  included  familiarity  and  pre-test  performance  score  on  the 
dependent  variables  being  examined. 

Treatment  variables  were  . entered  next  into  the  regression 
equation.    Due  to  the  fact  that  thMs  statistical  procedure  limits 
one  to  K-1  (i.e.,  two  contrasts  [see  Cohen  &  Cohen,  1975]),  two 
major  contrasts  were  examined  in  this  study.    To  assess  the  extent 
to  which  comprehension  of  gist  information  was  associated  wjth  any 
■  treatment,  the  contrast  (labeled  T^, )  between  membership  in  any 
treatment  condition  and  membership  in  a  non-treatment  conditions 
(Strategy  +  Read-Study  v.  Control )  was  examined.    To  assess  the 
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extent  tb  which  exposure  to  a  particular  treatment  accounted  for 
various  associated  with  the  comprehension  rneasures,  the  contrast 
(labeled       between  membership  in  the  two 'treatment  groups 
(Strategy  v.  Read-Study)  was  examined. 

Hierarchical  regression  analyses  using  these  sets  of  variables 
were  performed  for  the  recall  and  question  data  on  four  different 
test  passages.    Included  were  analyses  for:    mid-test  Biology 
Passage  2.  Biology  post-test  Passage  3.  History  post-test  Passage  4, 
and  delayed  Biology  post-test  Passage  5.    All  of  these  testi^ng 
situations  required  regression  analyses  on  each  of  seven  dependent 
raedsures:    recall  types  (text  reproductions,  entailments,  evocations, 
first  important  propositions,  secondary  important  propositions,  and 
total  propositions)  and  question  score. 

Results  and  Discussion  . 
Evidence  favoring  the  efficacy  of  Strategy  instruction  over 
Read-Study  practice  is  far  from  conclusive.    Evidence  supporting  the 
effectiveness  of  any  of  the  treatment  conditions  (Strategy  instruc- 
tion' and  Read-Study  practice)  over  the  non-treatment  (Control) 
condition  is  equally  non-conclusive. 

Examining  summaries  of  significant  main  and  interaction 
effects  (see  Tables  6.2  and  6.3  ),  it  is  advisable  to  mention  that 
on  a  macro  level,  of  all  the  analyses  performed,  three  observations 
restrain  considerably  any  generalisations  forwarded:    (1)  Strategy 
effectiveness  rarely  appears  as  a  main  effect;  (2)  significant 
interactions  rarely  appear;  and  (3)  occasionally,  out  of  these 
limited  number  of  interactions,  evidence  appears  favoring  the  non-  '  ^ 
treatment  condition  (Control  group).  ,  . 

No  strong  trends  appear  in  examining  data  ^cross  tJ^e  biold^y 
mid-test,  biology  post-test,  history  post-test,  and  delayed  post- 
test.    The  appearance  of  the  T2  contrast  as  j  significant  main 
effect  is  somewhat  supportive  of  the  Strategy  effectiveness  over 
Read-Study  condition.    Furthermore,  Strategy  instruction  is  implicated 
as  a  facilitative  condition  (when  compared  to  the  Read-Study  ) 
condition)  on  measures  of  secondary  important  propositions  (on  both 
the  Biology  mid-test  and  post-test)  and  question  score  '(on  the 
Biology  post-test) . 
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.  !        Table  6.2 

SUMMARY  OF  SIGNIFICANT  MAIN  EFFECT^ ON  REGRESSION  ANALYSES  FOR  GIST  RECALL  DEPENDENT  MEASURES 


Measures 

ri  1  U    i  c  b  t 

Passage  2 

D  1  u  1  uyjr 

Post-Test  Passage  3 

Post-test  Passage  4 

Dp 1 a vpH 

Post-test  Passage  5 

Text  Reproductions 

n .  s . 

**Readlng 

*Readlng 

'^Keacung 

Entailments 

*Pretest  '! 

n.s. 

n.s. 

n.s. 

Evocations 

n.s. 

n.s. 

n.s. 

n.s. 

First  Important 
Propositions 

*Reading 

n.s. 

n.s. 

n.s. 

Secondary  Important 
Propositions 

*Biology 
2 

(Strategy) 

**Reading 
**Fam11iarity 

(Strategy) 

**Reading 
*Pretest 
*Famil iarlty 

*Read1ng 
*Pretest 

Total  Propositions 

n.s. 

**Read1ng 

r  uiii  1  1  1  a  1  1  Ljr 

*Reading 

**keading 

Question  Score 

♦Pretest 

*Read1ng 
*Biology 

(Strategy) 

**Read1ng 

^Biology 



*Means  Favoring  Treatment  Conditions  at  p  <.05, 
**p  <.01 
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Table  6-. 3 


SUMMARY  OF  SIGNIFICANT  INTERACTION  EFFECTS  ON  REGRESSION  ANALYSES  FOR  GIST  RECALL  DEPENDENT  MEASURES 


Dependent 
Measures 

Mid-Test 
Passage  2 

Bidlogy 
Post-test  Passage  3 

History 
Post-test  Passage  4 

Delayed 
Post-test  Passage  5 

Text  Reproductions 

,  *T^x  Fam X  Pretest 

r; 

n.s. 

> 

*T2  X  Pretest 
*T2  X  Fam 
*T^  X  Fam 
*T^  X  Bio  X  Fam 

n.s. 

Entailments 

*Biol  X  Fam 

n.s. 

*T2  X  Rdg  x  Pretest 

n.s. 

**T2  X  Biol  X  Fam 

**T2  X  Biol  X  Fam 

X  Biol  X  Fam 

Evocations 

n.s.  • 

n.s. 

n.s. 

n.s. 

First  Important 
Propositions 

n.s. 

**T2  X  Pretest  x  Fam 

A 

**T2  X  Fam 
*T^  X  Rdg  X  Biol 

-f-"  

'  n.s. 

Secondary  Important 
Propositions 

n .  s . 

n.s. 

**T^  X  Fam 

♦T^  X  Rdg  X  Biol 

Total  Prepositions 

n.s. 

n.s. 

**T2  X  Fam 

*T^  X  Rdg  X  Biol 

Question  Score 

n.s. 

n.s. 

^2  X  Biol 

*T2  X  Rdg  x  Fam 

*Means  Favoring  Treatnent  Conditions  at  £<.05 
**£<  .01  ^  \. 
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In  general,  results  are  contextually-specific.    The  Strategy 
instruction  was  perhaps  too  task-specific .  yielding  more  localised 
then  general izable  effects.    The  absence  of  T^  contrasts  suggests 
that  when  considered  together,  the, effects  of  the  two  treatment 
conditions  are  not  too  different  from  the  effect  of  the  non-treatment  . 
condition.    The  frequency  of  significant  interactions  occurring  on 
the  history  post-test,  the  subject  matter  most  unlike  the  instruc- 
tional materials,  suggest  the  presence  of  other  variables  not 
specifically  considered  in  this  study.  . 

What  these  results  suggest  is  that  in  this  study,  as  in  most 
classrooms,  there  are  a  host  of  context  variables  which  infl uence 
learning  (comprehension)'.    What  makes  these  data  interesting  (though 
difficult  to  generalize  from)  is  that  there  are  so  many  descriptively 
rich- contextuaVly-speci fie  effects.    It  may  be  the  case  that, 
considering  the  host  of  variabiles  represented  (e.g.,  different 
topics,  different  passage  subject  matter),  it  was  not  reasonable 
to  expect  patterns.    Conversely,  perhaps  there  are  patterns  emerging 
from  the  results,  but  they  are  obscured,  indicating  the  presence  of 
contextual"  variables  not  specifically  considered  in  this  study. 

Predictions  concerning  question  score  were  not  confirmed.  In 
fact,  very  few  significant  effects  appeared.    On  the  measures  of' 
recall  and  important  ideas',  overall  results  reveal  no  confirmation 
of  the  predictions  made.    Examinations  of  tendencies  within  groups, 
however,  yield  valuable  description  about  subjects'  recall 
performance. 

The  type  of  recall  found  least  often  in  performance  of  the 
Strategy  group  was  text  reproductions.    Instead  of  producing  text 
reproductions.  Strategy  subjects  tended  .to  produce  entailments. 
This  suggests  that  Strategy  instructionVjiay  have  encouraged  subjects 
to  draw  upon  previous  knowledge  and  background  information  in 
synthesizing  information  (to  produce  entailments)  rather  than 
encouraging  the  production  of  verbatim  recall  (text  reproductions). 
Across  all  testing  passages,  more  effects  for  Strategy  effectiveness 
appeared  on  the  history  post-test  and  on  the  delayed  post-test, 
indicating  some  transferability  of  Strategy  instructional  benefits 
may  have  occurred. 
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The  Read-Study  condition  seemed  to  facilitafe  production  of 
text  reproductions  and  entailments.    This  indicates  that,  in 
comparison  with  the  Strategy  condition,  the  Read-Study  practice 
encouraged  both  verbatim  recall  and  the  higher  level  processing 
entailments.    In  comparing  the  beneficial  effects  of  Strategy 
instruction  with  those  of  Read-Study  practice,  there  appears  to  be 
a  slightly  greater  tendency  for  the  Strategy  condition  to  benefit 
subjects  with  varying  levels  of  reading  ability,  biology  ability, 
and  topic  familiarity. 

The  type  of  recall  most  favored  by  the  Control  subjects  was 
text  reproductions.    This  suggests  that  the  non-treatment  regular 
classroom  instruction  promoted  verbatim  recall  (representing  lower 
levels  of  processing)  rather  than  entailments  (representing  higher 
^   levels  of  processing).    Results  also  emerged  indicating  the 
effectiveness  of  the  Control  condition  in  promoting  recall  of 
important  informatioi^^ver  that  of  both  the  Strategy  and  the' Read- 
Study  conditions.    ThesV  faciVitative  effects  suggest  the  possibility 
that  the  prevalent  tether-directed  discussions  observed  in  the 
Control  condition  promoted  the  recall  of  iljiportant,  text-based 
information. 

As  an  aid  for  recalling  gist  information  in  text,  the  Topic/ 
Subtopic  Strategy  do^s  show  some  potential.    It  may,  for  example, 
prove  especially  facilitative  in  helping  poorerf  readers  improve 
their  comprehension  of  text  materials.    What  mi^  be  of  greater  worth  , 
regarding  results  from  this  study,  however,  are  the  Implications 
which  may  be  drawn  concerning  how  instructional  research  should  be 
pursued.    It  may  be  that  a  heavy-handed,  direct  instruction  approach 
as  well  as  a  "road  race"  search  for  results  is  problematic.  The 
learning  which  was  most  exciting  was  that  which  occurred  at  moments 
during  the  instructional  sequence.    These  moments  were  characterized 
by  students  discovering  the  potential  for  and  use  of  the  strategies 
for  their  own  rather  idiosyncratic  purposes  at  the  same  time  as  they  ^ 
were  struggling  for  control  of  the  strategy  and  were  quite  critical 
of  its  worth.    It  is  this  struggle  and  negotiation  which  appears 
to  be  at  the  heart  of  strategy  acquisition  and  learning  to  learn 
from  text.    Rather  than  suggest  that  the  strategy  was  not  suitable 
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for  meeting  the  text-based  needs  of  students,  our  data  and  obser- 
vations support  its  introduction  but  in  a  more  indirect, soft-handed 
way.  < 
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VII 

TEXT  ENGINEERING 


Part  1:    The  Learnability  of  Ideal  Texts  Derived  From  Maps 
Diane  Schallert  \  Ernest  T.  Gdetz 

Michael  C.  Murphy  Robert  J.  Tierney 

One  conclusion  to  be  drawn  fromthe  results  described  in 
Section  III  is  th^t  textbooH^jgj^erials  are  not  always  as  helpful  as 
they  might  be.    For  example,  we  found  that  high-level  ideas  are  not 
explicitly  connected  to  the  lower-level  ideas  in  texts,  students 
have  problems  learning  implici^t  material,  topic  discontinuity  occurred 
frequently  in  our  sample  texts,  and  structural  patterns  of  ideas  in 
text  varied  widely  in  how  clearly  and  simply  they  were  presented. 
In  this  section,  we  test;ed  the  hypothesis  that  the  engineering  of 
texts  would  improve  their  learnability.    Specifically,  we  predicted 
that  texts  would  be  improved  if  rewritten  using  the  map  as  a  guide 
for  the  underlying  structure  of  ideas.    Since  the  map  is  an  explicit 
representation  of  all  the  ideas  and  of  all  their  interrelationships 
needed  to  make  a  coherent  discussion  of  a  topic,  it  should  serve 
well  as  a  guide  to  producing  a  surface  text  that  comes  close  to 
what  an  author  must  have  intended  to  say. 

In  ajjdition,  we  were  interested  in  the  effect  of  providing 
students  with  study  guide  questions  that  either  did  or  did  not  match 
the  underlying  overall  pattern  of  ideas  in  the  text  (as  described  in 
Section  II  1. 5).    As  we  mentioned  in  Section  1 1 1. 2,  we  Vound  that  even 
texts  with  a  clearly  signaled  structure  could  be  approached  from  a 
different  perspective,  witji  indifferent  structure  in  mind.    We  were 
interested  in  the  effepiTof  study-guide  questions  on  what  students 
would  learn  from  teia  samples.    What  follows  is  a  brief  description 
of  the  procedure y<^e  implemented  to  test  these  ideas.    Note  that, 
unfortunately,  wd  have  not  yet  analyzed  the  data  gathered  and 
cannot  at  this  time  give  an  answer  to  the  questions  we  posed. 

The  same  subjects  who  participated  in  the  training  study 
described  in  Section  VI. 1,  also  participated  in  this  procedure. 
Therefore,  one  factor  represented  in  the  design  was  whether  subjects 
had  received  training  in  mapping  as  a  study  strategy  oif^  whether 
they  were  part  of  the  control  group.    These  two  groups  were  each 
divided  into  two  sub-groups.    One  half  of  the  students  received 
study  questions  prior  to  reading  the  text  material  that  were 
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appropriate  In  terms  of  reflecting  the  underlying  structural  pattern 
of  the  text  to  be  read.    The  other  half  received  1nappropr1ate-«tudy , 
questions,  questions  that  could  be  answered  by  the  tej^t  but  that 
required  taking  the  Ideas  presented  and  connecting  thert  with  a 
different  set  of  Klgh-level  relationships.    Thus,  a  compare/contrast 
text  might  have  as  an  appropriate  study  question  tj)  compare  two 
topics,  and  as  an  inappropriate  question  to  describe  one  or  both 
tqplcs. 

All  participants  read  one  text  in  its  original  version  and  one 
text  rewritten  to  make  explicit  th|  connections  between  ideas  and 
any  ideas  (concepts)  left  implicit  in  the  original.    Tf^two  texts 
were  both  from  the  Biology  set.  Text  #104*  Reproductive  Sy^item  of 
the  Frog,  and  Text  #115,  the  Linnaen  System.    In  Section  III. 5, 
these  two  texts  were  Identified  as  clear  representaltives'of  chrono-  . 
logical  organization  and  comparison  organization,  respectively. 
This  topic  was  nested  within  text  pattern  and  for  anyone  subject, 
this  was  nested  within  clarity  of  presentation.    Order  of  topic  and 
of  original  versus  rewritten  versions  of  the  texts  was  counterbalanced 
across  the  subjects.    The  original  versions  of  the  two  texts  can  be 
found  in  Appendix  D.    Here  we  present  the  rewritten  version  of 
Text  #104  as  an  example  of  what  we  mean  by  an  "ideal"  text. 

The  sex  organs  of  both  male  and  female  frogs  are 
internal.    Because  of  this,  it  is  hard  to  tell  the  sex( 
apart,  except  during  the  breeding  season,  when  the  thynibs 
of  the  male  are  enlarged. 

Two  oval  testes  are  the  major  repro'dticti ve  Organs 
in  the  male  reproductive  system.    The 'testes  are  a  creamy- 
white  or  yellow  color.    They  lie  in  the  back,  one  on  each 
side  of  the  spine,  in  the  anterior  region  of  the  kidjpeys. 
Sperm  cells  develop  in  the  testes.    Upon  leaving  the 
testes  the  sperms  pass  through  tubes,  called  the  vasa 
efferentia,  and  into  the  kWneys.    As  the  sperms  are 
discharged  they  pass  into  the  ureters.    Some  frog  species 
have  an  enlargement,  called, the  seminal  vesicle,  at  the 
base  of  each  ureter.    From  the  ureter  the  fiperms  pass 
into  the  cloaca.  / 


In  the  reproductive  system  of  the  female  frog,  the 
eggs  develop  in  a  pair  of  large  lobed  ovaries.  The 
ovaries  lie  along  the  back  above  the  kidneys.  During 
the  breeding  season,  the  eggs  enlarge  and  burst  through 
the  thin  ovary  walls.    This  frees  the  eggs  into  the  body 
cavity.    Once  In  the  body  cavity,  the  abdominal  muscles 
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work  the  eggs  toward  the  anterior.    In  the  anterior 

lies  the  opening  ^to  the  oviduct/  This  opening  is 

f unnel -like  and  lined  with  Gilia.    Tlie  clvli a  sucks 

the  eggs  into  the  oviducts.    The  oviducts ,^hich 

are  long  and  coiled,  lead  into  the  cloaca.  Near- 

the  openings  to  the  cloaca,  the  walls  of  the  oviduct  . 

secrete  a  jellylike  substance.    This  substance 

surrounds  each  egg.  From  the  cloaca  the  eggs  pass 

into^ the  sdcl ike  uterus.    The  uterus  is  located  at 

the  base  of  each  oviduct..  Here  the  eggs  are  stored 

until  they  are  laid. 

The  students  were  instructed  to  keep  the  study  questions  presented 
along  with  text  in  mind  as  they  read.    If  they  were  in  the  "appro- 
^priate"  group,  they  saw  the  following  study  questions  for  Text  #104: 

1.  Describe  the  male  reproductive  .system  from  the 
time  the  sperm  cells  develop  until  they  are 
discharged. 

2.  Describe  the  female  reproductive  System  from  the  ^ 
^  time  the  aggs  are  developed  until  they  are  laid. 

If  they  were  in  the  "inappropriate"  group,  they  saw: 

1.  Compare  the  reproductive  organs  of  the  male 
to  that  of  the  female  frog. 

2.  How  are  the  reproductive  systems  in  the  male  and 
female  frog  alike  and  how  are  they  different? 

They  then  read  the  text,. 

Measures  included  a  metacognition  rating  question,  the  same 

study  questions  presented  with  the  texts  only  now  presented  as 

essay  questions,  and  finally,  four  short-answer  questions  related  to 

specific  information  in  the  texts,  identified  as  high'and  low  level 

and  explicit  and  implicit  according.to  the  list  of  relationship 

propositions.    For  example  for  Text  #104,  the  four  short-answer 

questions  were:    ^ 

(High/explicit)  ^1.,  Where  specifically  are  the  testes 

located? 

(High/implicit)    2.  What  happens  after  the  eggs  in  the 

female  have  enlarged? 

(Low/explicit)     3.  Wh^it    reproductive  organ  is  i 

lined  with  ciliated  cells? 

(Low/implicit)     4.  When  the  eggs  Jeave  the  oviduct, 

where  do  they  go?  ' 

V  . 
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Finally,  the  students  responded  to  a  rating  question  asking  them 
how  familiar  they  had  been  with  the  topic  of  the  text  before  they 
had  read  about  it  as  part  of  these  experimental  materials. 

Once  they  had  completed  these  measures  on  the  first  text  of 
their  packets,  the  students  followed  the  same  procedure  for  a 
second  text. 

Results  will  be  analyzed  to  answer  the  following  questions: 
(1)  Do  students  learn  more  from  texts  that  have  been  rewritten 
to  make  explicit  their  underlying  message  than  from  texts  in  their 
original ,  naturally  Occurring  states?  (2)  Do  students  learn  more 
when  given  study-guide  questions  that  match  the  overall  pattern  of 
high-level  ideas  or  do  they  benefit  when  given  a  different  pers- 
pective or  approach  to  the  texts?  (3)  Will  there  be  an  effect 
shown  in  the  performance  of  students  trained  in  mapping,  a  strategy 
that  should  encourage  them  to  focus  on  and  make  explicit  the 
organization  of  ideas  in  an  author's  message?    Answers  to  these 
questions  should  provide  a  basis  for  recommendations  to  textbook 
authors  and  to  the  authors  of^the  ubiquitous  study-guide  questions, 
instructional  objectives,  and  textbook  exercises  that  accompany 
textbooks.  « 
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PART  2:    THE  EFFECTIVENESS  OF  ENGINEERED  CONPARE/CONTBAST  TEXTS 
Ester  Geva  Robert  Tierney 

There  were  several  reasons  for  examining  the  influence  of  various 
manipulations  of  compare/contrast  texts.    Apart  from  the  fact  that 
hese  texts  emerged  from  our  previous  analyses  (see  section  3.5)  as 
ne  of  the  clearest  text  types,  there  were  a  number  of  practical  and 
research-based  reasons  to  warrant  our  examination.    In  courses  on 
writing,  systematic  variations  of  compare/contrast  texts  receive  a 
tat  deal  of  emphasis,  without  a  thoughtful  consideration  for  the 
benefits  or  drawbacks  of  these  different  variations.    In  various 
fields  of  study,  teachers  present  information  on  different  topics  in 
compare/contrast  forms  or  ask  question  that  require  compare/contrast 
analyses.    For  example,  a  history  teacher  might  present  information  ^ 

differerrt ^events  and  expect  students  to  make  comparisons  on 
their  causes  or  effects.     Also,  the  research  literature  Suggests 
some  interesting  findings  pertaining  to  compare/contrast  texts. 
Geva  and  Hildyard  (1979K  fop  example,  have  argued  that  these  texts 
represent  a  more  difficult  type  of  text  structure.    In  addition, 
agaiwt  a  background  of  unclear  effects^for  connectives  in  other 
research,  Geva  &  Hildyard  have  suggested  that  connectives  appear  to 
have  an  interactive  effect  with  this  type  of  text. 
Method 

Materials.    For  purposes  of  examining  the  effects  of  systematic 
variations  of  compare-contrast  texts,  four  passages  were  selected  and 
systematically  manipulated.    These  manipulations  involved  the  omission 
of  cohnectives  as  well  as  inclusion  of  structural  variation.  The 
structural  characteristics  of  the  texts  were  varied  by  intermixing  or 
separating  the  information  being  presented.    In  the  separated  versions, 
the  discussion  of  each  point  of  view  was  kept  distinct  from  one  another. 
In  the  mixed  version,  the  discussions  of  the  two  points  of  view  were 
integrated,  point  by  points    Examples  of  the  passage  which  were  developed 
for  one  topic  are  presented  in  Tables  7.1    to  7.4  . 

Design.    The  study  used  a  4  X  4  split  plot  design  with  repeated 
•  measures.    Subjects  were  tested  within  version  type  created  by  the 
crossed  factors  of  separate/mixed  and  connectives/no  connectives. 


Table  7.1 


Version  Mixed/Connective 


In  recent  months,  Brigadier-General  Paul  Manson  led  a  project 
team  charged  with  selecting  a  new  fighter 'aircraft  for  the , Canadian 
Armed  Forces.    Two  planes  wer6  wnder  consideration:    the  twin-engined 
McDonnell  Douglas  Corp.  F-18  arKl  the  single  engined  General  Djjfnamics 
Corp.  F-16.  '  ^  . 

When  the  two  aircraft  were  first  looked  at  an  an  airplane  to  air- 
plane basis,  early  in  the  $2.3  billion  program,  there  was  little  to 
distinguish. between' thera.    Gqneral  Manson  said  in  an  interview  that 
'while  at  the  beginning  both  seemed  to  be  "great  airplanes",  it  was 
when  the  fine-tuning  began  that  noticeable  and  meaningful!  differences 
began  to  show  up. 

The  F-16- has  .  better  speed  and  highej?  marteuve^bil  ity  than  the 
larger  F-18.    Both  airplanes  are  expected  to  be  ,in\the  armed  forces' 
inverttory  until  at  least  the  turn  of  the  century  a rfd  the  large  F-18 
has  a  better  capacity  for  the  internal  growth  of  its  systems  over  the 
technological  life  of  theplane.   Also  taken  into  account  were  the 
engines  powering  each  plance.    The  P-404  engine  that  powers  the  F-18, 
.built  by  the  General  Electric  Company  aviation  group  of  Lynn,  Massachu- 
setts, is  an  exceptionally  fine  engine,  as  is  the  F-lOO  engine  of  the 
F-16,  built  by  Pratt  and  Whitney  of  Hartford,  Connecticut.  However, 
the  P-404  engine,  of  the  T-18  is  a  simpler  engine  than  the  F-lOO 
engine  of  the  F-16-,  it  does  not  represent  the  high  technological  ad- 
vance of  the  F-lOO  engine  (of  the  F-16)  ,  but  it  is 'easier  to  main- 
l   tain  and  repair.  '  Moreover,  the  P-404  twin  engines  of  the  F-18  have 
fewer  j)arts  than  the  F-lOO  single  engine  bf  the  F-16. 

There  has  been  some  concern^with  respect  to  the  durability  of  the 
F-16.    Would  the  aircraft  be  able  to  stand  "up  to  the  demands  that 
wbuld  be  made  on  it?   General  Manson  said  that  over  the  1  if ei  of  the 
aircraft  there  might  be  fewer  peacetime  losses  with  the  twin-engined 
F-18.    "If  you  have  a  flame  out  on  patrol  with  the  F-18,  at  least  you 
can  be  sure  of  .getting  home  on  the  other  engine."    On  the  .other  hand, 
the  more  advanced  F-l§  may  be  less  susceptible  to  flame-outs. 

Still,  the  initial  investment  will  be  higher  for  the  F-18  than  for 
the  F-16  since  the  F-18  is  an  expensive  plane.    However,  attrition  on 
the  F-18  is  expected  to  be  lower. 

The  recommendation  of  the  committee  has  gone  to  the  government 
and  Generel  Manson  said  that  he  expected  an  announcement  would  be  made 
some  time  in  the  late  spring. 
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Table  7.2 


Version  Mixed/No  Connectives 


InVecent  months,  Brigadier-General  Paul  Manso^Ried  a  project 
team  charged  with  selecting  a  new  fighter  aircraft  ^  the  Canadian 
Armed  Forces.    Two  planes  were  under  cdrisideration:    the  twin-engined 
McDonnell  Douglas  Corp.  F-18  and  the  single  engined  General  Dynam1t:s 
Corp.  F-16 

When  the  two  aircraft  were  first  looked  at  on  an  airplane  to  air- 
plane basis,  early, 1n  the  $2.3  billion  program,  there  was  little  to 
distinguish  between  them.    General  Manson  said  in  an  interview  that 
while  at  the  beginning  both  seemed  to  be  "great  airplanes** ,  it  was 
when  the  fine-tuning  b6gan  that  noticeabl e' and  meaningful  differences 
began  to  show  up. 

The  F-16  has  better  sp^ed  and  higher  maneuverability  than  the 
larger  F-18.    Both  airplanes  are expected  tq  be  in  the  armed  forces* 
inventory  until  at  feast  the  turn  of  the  century.    The  large  F-18  has 
a  better  capacity  for  the  internal  growth  of  its  systems  over  the 
technological  life  of  the  plane.    Taken  into  account  were  the  engines 
powering  each  plane.    The  P-404  engine  that  powers  the  F-18,  built 
by  the  General  Electric  Company  aviation  group  of  Lynn,  Massachusetts, 
is  an  exceptionally  fine  engine^  as  is  the  F-lOO  engine  of  the  F-16, 
built  by  Pratt  and  Whitney  of  Hartford,  Connecticut.    The  P-404  engine 
of  the  F-18  is-  a  simpler  engine  than  the  F-lOO  engine  of  the  F-16.  It 
is  easiei?,  to  maintain  and  repair.    The  P-404  twin  engines  of  the  F-18 
have  fewer  parts  than  the  F-lOO  single  engine  of  the  F-16. 

There  has  been  concern  with  respect  to  the  durability  of  the  F-16 
Would  the  airdr]0t  be  able  to  stand  up  to  the  demands  that  would  be 
made  on  it?    General  Manson  said  that  over  the  life  of  '^ti^e  aircraft, 
there  might  be  fewer  peacetime  losses  with  the  twin-engined  F-18. 
"If  you  have  a  flame  out  on  patrol  with  the  F-18,  at  least  ytuj^can^  be 
sure  of  getting  home  on  the  other  engine."    The  more  advanced 
may  be  less  susceptible  to  flame  outs.  ^ 

The  initiar  investment  will  be  higher  for  the  F-18  than  for  the 
F-16.    The  F-18  is  an  expensive  plane.    Attrition  on  the  F-18  1s 
expected  to  be  lower.. 

The  recommendation  of  the  committee  has  gone  to  the  government. 
General  Manson  said  that  he  expected  an  announcement  would  be  made 
some  time  in  the  late  spring. 
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Table  7,^/^ 
Version  Seperate/Connectives 


,     In  recent  months,  Brigadier-General  Paul  Manson  led  a  project 
team  charged  with  selecting  a  new  fighter  aircraft  for  the  Canadian 
Armed  Forces.    Two  planes  were  under  consideration:    the  twin-engined 
McDonnell  Douglas-  Corp.  F-18  and  tffe  single  engined  General  Dynamic 

Corp.  F-16.  .  * 

When  the  two  aircrafts  were  first  looked  at  on  an  airplane  to 
airplane  basis,  early  in  the  $2.3  billion  program,  there  was  little 
to  distinguish  between  them.    General  Manson  said  in  an  interview  that 
while  at  the  beginning  they  both  seemed  to  be  "great  airplanes",  it 
was  when  the  fine  tuning  began  that  noticeable  and  meaningful  differ- 
ences began  to  show  up. 

The  F-16  has  a  good  speed  and   high  maneuverability.    Also  taken 
Into  account  was  its  exceptionally  fine  engine,  the  F-lOO,  built  by 
Pratt  and  Whitney  of  Hartford,  Connecticut.    This  engine  represents 
a  high  technological  advance  and,  moreover,  incorporates  many  more 
parts  into  its  sfngl'e  engine.    However,  there  has  been  some  concern 
with  respect  to  the  durability  of  the  F-16.    Would  the  aircraft  be 
able  to  stand  up  to  the  future  demands  that  would  be  placed  on  it? 

Both  airplances  are  expected  to  be  in  the  armed  forces'  inventory 
until  at  least  the  turn  of  the  century,  and  the  large  F-18  has  a  better 
capacity  for  the  Internal  growth  of' its  system  over  the  technological 
life  of  the  plane.    Furthermore,  the  P-404  engine  that  powers  the  F-18,/ 
built  by  the  General  Electric  Company  aviation  group  of  Lynn,  Massa-  ' 
chusetts,  is  an  exceptionally  fine  engine  though  it  does  not  represent 
high  technological  advance.    In  addition,  the  P-404  is  a  simple  engine, 
it  has  fewer  parts,  and  is  easy  to  maintain  and  repair.    With  respect 
to  durability.  General  Manson  said  that  over  the  life  of  the  aircraft 
there  would  likely  be  few  peacetime  losses  with  the  twin-engined  F-18. 
"If  you  have  a  flame  oOt  on  patrol  with  the  F-18,  at  least  you  can  be 
sure  of  getting  home  on  the  other  engine."    Yet  the  initial  investment 
for  the  F-18  would  be  high,  since  the  F-18  is  an  expensive  plane.  How- 
ever its  attrition  rate  is  expected  to  be  low. 

The  recommendation  of  the  committee  has  gone  to  the  government 
and  General  Manson  said  that  he  expected  an  announcement  would  be  made 
some  time  in  the  late  spring.!  The  committee  will  have  to  base  its 
decision  on  an  combination  ofScriteria  such  as  initial  investment, 
safety  and  performance. 
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Version  Separate/No  Connectives 

In  recent  months,  Brigadier-General  Paul  Manson  led  a  project* 
team  charged  with  selecting  a  new  fighter  aircraft  for  the  Canadian 
Armed  Forces.    Two  planes  were  under  consideration:    the  twin-engined 
McDonnen  Douglas  Corp.  F-18  and  the  single  englned  General  Dynamics 
Corp.  F-16. 

When  the  two  alrcrafts  were  first  looked  a't^on  an  airplane  to 
airplane  basis,  early  In  the  $2.3  billion  program,  there  was  little 
to  distinguish  them.    Genera,!  Manson  said  in  an  interview  that  while  * 
at  the  beginning  they  both  seemed  to  be  "great  airplanes",  it  was 
when  the  fine  tuning  began  that  noticeable  and  meaningful  differences 
began  to  show  up. 

The  F-16  has  m  good  speed  and  high  maneuverability.    Also  taken 
into  account  wastEs  exceptionally  fine  engine,  the  F-lOO,  built  by 
Pratt  and  Whibrtfy  of  Hartford,  Conneczicut.    This  engine  represents 
a  high  technological  advance  and,  njoreover,  incorporates  many  more 
parts  into  its  single  engine.    However,  there  has  been  some  concern 
with  respect  to  the  durability  of  the  F-16.    Would  the  aircraft  be 
able  to  stand  up  to  the  future  demands  that  would  be  placed  on  it? 

Both  airplanes  are  expected  to  be  in  the  armed  forces*  inventory 
until  at  least  the  turn  of  the  century,  and  the  large  F-18  has  a 
better  capacity  for  the  internal  growth  of  its  system  over  the  tech- 
nological life  of  the  plane.    Furthermore,  the  P-404  engine  that 
powers  the  F-18,  built  by  the  General  Electric  Company  aviation  group 
of  Lynn,  Massachusocts,.  is  an  exceptionally  fine  engine  though  it  does 
not  represent  high  \techno1ogica1  advance.    In  addition,  the  P-404 
is  a  simple  engine,  it  has  fewer  parts,  and  is  easy  to  maintain  and 
repair.    With  respect  to  durability.  General  Manson  said  that  over  the 
life  of  the  aircraft  there  would  likely  be  few  peacetime  losses  with 
the  twin-engined  F-18/    "If  you  have  a  flame  out  on  patrol  with  the 
F-18,  at  least  you  can  be  sure  of  getting  home  on  the  other  engine." 
Yet  the  initial  Investment  for  the  F-18  would  be  high,  since  the  F-18 
is  an  expensive  plane.    However,  its  attrition  rate  fs  expected  to  be 
low. 

The  recommendation  of  the  committee  has  gone  to  the  government 
and  General  Manson  said  that  he  expected  an  announcement  would  be 
made  some.time  in  the  late  spring.  ^  ^ 
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Subjects  were  crossed  with  topics  (Anglo  Americans  versus  Mexican 
Americans,  Solid-fuel  versus  Liquid-fuel  rockets.  F-18  versus  F-16 
planes.  Alternative  causes  for  JuvenlTe  Delinquency),    In'other  words, 
subjects  read  the  same  version  type  of  each  of  the  four  text  topics. 
After  reading  each  text,  students  were  given  a  distractor  exercise  prior 
to  being  asked  to  generate  a  written  recall. 

Subjects.    Participants  were  62  high  school  students  at  a  junior 
or  senior  level  from  a  semi-rural  area  in  Illinois.    Most  students' 
parents  worked  in  local  industrial  plants  or  were  farmers.  The 
students'  standardized  test  scores  suggested  they  represented  a  nor- 
mal range  of  reading  abilities  for  students  their  age. 

Analysis  of  recall .  .Subjects'  recall  protocols  were  scored  by 
translating  them  into  propositions, v then  comparing  them  to  the  .template 
text  base,  and  classifying  them  intii  types  of  propositions.    Based  upon 
a  scoring  system  devised  by  Drum  W^),  units  of  information  in  the 
subjects'  recalls  were  scored  as  t^xt  reproduction  (statements  1dexy:ical 
with  or  synonymous  with  propositions  from  the  text),  text  entailments 
(statements  which  represented  generalizations,  summary  statements  or 
transformations  of  the  text),  text  evocations  (statements  which  were 
plausible  inferences  from  the  text),  unrelated  (statements  which  seemed 
implausible  or  irrelevant)  and  errors  (statements  which  represented  mis- 
information).   For  analysis  purposes,  the  scores  derived  for  text  repro- 
ductions ,^  text  entailments  and  text  evocations  were  totalled. 

^Recalls  were  also  examined  more  globally.    That,  is,  each  recall 
was  examined  for  evidence  of  resol ut1on--a  judgementof  the  worth  of 
one  object  or  point  of  view  over  the  other  objector  point  of  view  being 
compared.    For  this  purpose,  recalls  were  classified  according  to  judges 
estimate  of  whether  the  students'  recall  best-represented  one  of  the 
following:    a  description  or  listing  of  details  without  any  evidence 
of  resolution  or  comparison;  a  comparative  analysis  of  details  with- 
out any  evidence  of  resolution;  or  an  indica.tion  of  resolution  or 
preference  for  one  point  of  view. 

Finally,  each  recall  was  examined  for  any  evidence  of  connective- 
ness.    Whenever  a  reader  included  a  form  of  conjunction  in  their  recall. 
It  was  classified  and  tabulated.    For  our  present  analyses,  a  frequency 
count  of  connectives  was  made. 
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Resul ts 

<Across  the  four  sets  of  passages,  a  recurring  finding  emerged. 
Regardless  of  topic  (Anglo-American  versus  Mexican^Americans ,  Solid- 
fuel  versus  Liquid-fuel  rockets,  causes  of  of  juvenile  delinquency, 
F-16  versus  F-18  planes),  one  text  condition  emerged  as  more  potent. 
Specifically,  subjects  in  the  mixed  compare-contrast  condition  with 
connectives  recalled  more  information,  included  less  errors  in  their 
recalls,  used  more  conjunctions  and  more  of  these  subjects  generated 
a  resolution  for  the  comparison.    Consider  the  data  for  two  of  the 
four  sets  of  the  passages  (see  Table  7.5  ). 

Subjects  who  read  the  text  condition  which  was  mixed  with  connec- 
tives included  more  Information  and  made  fewer  errors.    The  difference 
between  this  version  and  all  other  text  variations  remained  stable 
across  all  text  topics. 

Also,  for  the  mixed  conditon  wi th  connectives ,  subjects  included 
"  more  conjunctions  in  their  recalls  and  were  more  prone  to  resolve  the 
comparisons  (see  Table  7.6  ).    Certai()ly,  it  can  be  argued  that  recalls 
may  not  lend  themselves  to  an  analysis  of  conjunctions  and  that  the  use 
"Of  conjunctions  may  or  may  not  be  related  to  a  more  coherent  memory 
for  text.    Nonetheless,  these  data  do  at  least  provide  some  /:ollabora- 
tion  for  qualitative  differences  due  to  text  variations.  ^ 

With  respect  to  resolution,  a  similar  Argument  can  be  made.  Again, 
recalls  may  not  be  the  most  appropriate  method  by  which  readers*  reso- 
lution of  a  comparison  might  be  measured.    Yet  these  data  do  seem  to 
corroborate  with  our  other  findings.    In  this  regard,  if  the  resolution 
of  comparisons  is  desired,  then  the  rtcall  data  support    the  mixed 
condition  with  connectives  over  other  ways  of  presenting  comparisons. 
Conclusions 

Taken  together  these  data  suggest  that  the  recalls  of  students' 
for  compare/contrast  texts  are  very  susceptible  to  systematic  variations 
of  these  texts.    In  general,  they  support  the  thesis  that  text  manipu- 
lations can  and  do  have  an  impact  upon  students'  memory  for  text  with 
respect  to  compare/contrast  texts.    They  suggest  that  students  are  apt 
to  recall  different  amounts  of  information  and  produce  qualitatively 
different  recalls  if  they  are  presented  information  in  altef^native 
overall  structures  with  and  without  explicit  connectives.    From  a 


Table  7.5 


Anglo-American 

versus 
Mexican-American 

Text  Units     Errors  1n 
Recalled  Recall 


Connectives 


Separate 


Mixed 


6.5 


No  Connectives  6.6 
Connectives  7.6 
No  Connectives  5.6 


J 

1.5 


1.2 
1.0 
1.6 


Sol  Id-fuel 

versus 
Liquid-fuel 


Text  Units 
Recal  1  ed 

J 

6.6 


9.3 
10.4 
8.4 


Errors  In 
Recall 
J 

1.1 


.5 

.36 

.88 


Table  7.6 

Mean  Number  of  Conjunctions  and  Resolution^ 
In  Written  Recalls 


Separate 


Mixed 


Connectives 
No  Connectives 
Connectives 
No  Connectives 


Conjunctions 
3.96 

4.51 

5.41 

4.54 


Resolutions 
.2 

.1 

.^25 
.2 
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practical  perspective,  these  data  suggest  that  if  more  recall^,  with 
fewer  errors  and  more  likelihood  of  resolution  is  the  goal  for  using 
i  compare/constrast  texts,  then  the  most  facilitative  way  of  presenting 

the  information  Is  to  use  a  mixed  condition  with  connectives.  This 
finding  should  be  considered  by  educators  and  writer?  of  educational  ^ 
materials. 
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We  began  with  a  general  goal  of  describing  the  nature  of  the 
language  found  In  content-area  textbooks  and  of  how  students  learn 
from  their  texts.    We  approached  this  general  goal  through  a  series 
of  theoretical,  methodologlpal  and  empirical  Investigations  guided 
by  five  specific  project  goals: 

1.  To  describe  how  high  school  students  awd  teachers  ^ 
perceive  and  use  their  textbooks . 

2.  To  define  the  characteristics  of  expository  text 
language  in  diverse  fields  of  study. 

3.  To  examine  the  interaction  of  text  characteristics 
with  reader  characteristics  as  students  learn 

^  '  from  text . 

4.  To  determine  the  Influence  of  instructional 
procedures  upon  students'  ability  to  le*rn  fxoni 
text . 

5.  To  determine  the  Influence  of  text  manipulations 
upon  the  quality  of  what  students  learn  from  text. 

U\  this  last  section  of  our  report,  we  summarize  the  conclusions 
Je  believe  are  suggested  by  our  Investigations  and  describe  the 
products  we  have  developed  in  the  course  of  working  toward  a 
fulfillment  of  our  project  gqals. 
Methodological  Tools 

As  we  began  our  investigations we  immediately  felt  the  need 
to  create  two  special  measurement  and  analysis  tools.    One  was 
related  to  a  measure  of  students*  views  of  the  use  of  their  text- 
books and  difficulties  they  incur  when  studying.    Since  we  could 
not  locate  a  relevant  sun/ey,  we  developed  oyr' own  questionnaire 
(see  Section  II  and  Appendices     A  and  B),,  comprised  of  four  major* 
sections  and  individual  items. 

As  we  attempted  to  describe  selected  samples  of  text  taken 
from  naturally-occurring  textbooks,  we  were  not  completely 
satisfied  with  the  focus  of  available  systems  of  analysis..  Those 
that  were  sufficiently  detailed  best  lent  themselves  to  the, 
description  of  text  demands  as  a  comprehender  builds  a  construc- 
tion of  a  text,  ward-by-word  or  proposition-by-proposition.^ 
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since  we  had  undertaken  to  describe  expository  text,  we  were 
Interested  In  whaflie  saw  as  the  major  function  or  Intent  of  such 
text,  to  iget  readers  to  acquire  new  concepts  and  new  ways  of 
organizing  concepts.    We  needed  a  text  analysis  system  tH^t  deaj 
less  with  the  surface  representation  of  text  an^Tmore  with  the 
underlying  concepts  and  structures.    Further  *  we  wanted  a  system 
that  would  represent  what  the  author  Intended  students  to  lejDo^  from 
the  text.    To  fulfill  these  requirements ;and  needs,  we jle;^ loped 
relational  mapping  (see  Section  III  J ) ,  Wfillph  we  see  as  a  text  | 
analyslis  system  specifically  suited  to  describing  wh^  students 
shoula  (need)  learn  when  they  read  expository  text. 

wiese  two  products,  the  questionnaire  and  the  text  analysis 
method,  were  unplanned  and  only  developed  In  response  to  particular 
research  needs  we  encountered  as  we  began  the  project.    Yet,  we 
feel  they  may  have  more  enduring  value ^than  our  empirical  findings 
In  view  of  the  typically  short  half-11f6  of  research  results  In 
the  social  sciences.    We  have  already  received  many  requests  for 
the^xtbook  survey  and  for  descriptions  of.  relational  mapping. 
We,  as  researchers  and  educators,  are* often  more  Interested  In 
and  have  A  greater  need  far  approaches  and  tools  to  help  us  Inves- 
tigate phenomena  of  our  own  choosing  than  to  acquire  one  more, 
report  of  the  results  of  someone^s  Investigation. 
Conclusions  from  Empirical  Investigations 

Throughout  the  course  of  the  project,  w6  and  our  students  and 
associates  were  Involved  In  twelve  experimental  •procedures .  In 
this  next  section,  we  briefly  describe  the  majoir  conclusions  we 
feel  are  suggested  by  the  data  gathered. 

Experiment  1,  results  of  the  survey  of  students*  use  of  their 
textbooks.    Students  reported  that  they  generally  read  the  assigned 
pages  In  their  textbook  all  the  way  through  8nly  once  and  that  they 
seldom  consulted  other  text  sources  or)  the  topic.    In  studying,  ^ 
their  preferred  strategy  was  to^memorUe  portions  of  the  text. 
Although  some  differences  were  observed  between  men  and  women 
students  and  between  Blolopr  and  History  classes,  generally  the 
same  restricted  range  of  uses  of  the  textbook  was  found. 


The  students  consistently  reported  that  their  textbooks  were 
difficult  because  important  ideas  were  not  identified  for  them, 

they  seemed  to  be  expected  to  know  more  about  the  topic  than  was 

•  .     .    ■     ■     f>  ■  "  ♦ 

actually  the  case,  not  enough  examples' and  clarifications  of  key 
ideas  were  provided,  and  the  textbooks  were  just  plain  boring.  In 
terms  of  their  perception  of  the  effectiveness  of  their  strategies 
as  they  studied  their  textbooks,  students  mentioned  that  their 
majbf  difficulties  were  with  concentrating  while  reading,  remember 
ihg  what  was  read,  knowing  how  well  the  information  just  read  will 
be  remembered  later  on  and  being  able  to  identify  how  ideas  were 
related. 

Experiment  2,  the  nature  of  textbook  language*    We  began  by 
askinghigh  school  teachers  to  identify  critical  sections  of  a 
chapter  that  was  still  to  come  in  the  curricufum.    Those  sections, 
identified  as  instructionally  important,  were  reduced  to  30 
samples  of  approximately  300  words,  16  from  Biology  and  14  from 
American  History  textbooks.    The  30  passages  were  submitted  to 
relational  mapping  analysis.    Results  generally  indicated  that  the 
authors  of  our  samples  were  frequently  imp! iciit  about  how  ideas 
they  were  expressing  were  logically  connected  to  each  other.  High 
level  ideas,  or  ideas  that  are  close  to  the  main  topic  of  a  text, 
were  just  as  likely  to  remain  implicitly  tied  to  other  ideas  in  a 
text  than  low  level  ideas.    In  addition,  we  found  that  our  authors 
relied  on  properties  and  examples  as  the  major  way  of  developing 
topics.    Nevertheless,  24%.of  their  ideas  pe^rtained  to  the 
distinctive  relationships  (definition,  comparison,  temporal,  and 
causal)  that  relatiofial  mapping  depicts  so  well.  " 

Experiment  3,.  the  learnability  of  textbook  language.  The 
sample  texts  identified  and  analyzed  in  Experiment  2  above  were 
presented  to  students  to  learn.  The  free  recalls  produced  by  the 
students  were  an?ilyzed  by  comparing  t;hem  to  the  appropriate  lists 
of  relationships  propositions.  Scores  for  each  text  unit  were 
computed  by  taking  the  proportion  of  students  who  had  pifH)duced 
that  unit  either  explicitly  or  implicitly  in  their  recalls. 

Results  indicated  that  in  general  texts  were  poorly  recalled, 
the  grand  mean  of  both  History  and  Biology  texts  being  below  2U. 

\    ■     ■■■ .     ■    ■  ■•:      ;  - 
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Text  units  that  were  only  ifnplied  by  authors  were  less  likely  to 
be  learned  than  text  units  that  were  explicit.    Example  proposi- 
tions, or  ideas  that. state  that  a  concept  is  tied  to  another  by 
virtue  of  being  its  example,  were  surprisingly  vulnerable  in 
students*  recall . 

On  a  more  positive  note,  students  were  sensitive  to  the 
centrality  of  any  idea  in  that  they  favored  ideas  high  in  text 
structure,  closely  tied  to  the  main  topic and  sub-topics  of  a  text. 
This  finding  is  in  agreement  with  results  stemming  from  a  number 
of  other  studies  and  lends  validity  to  the  concept  of  embeddedness 
as  defined  by  our  relational  mapping  analysis! 

Our  major  recommendation  to  textbook  authors  based  on  our 
findings  is  that  they  consider  making  the  connections  between  ideas 
more  explicit,  partitularly  when  relating  concepts  that  are  crucial 
to  the  development  of  a  topic.    To  teachers,  we  suggest  that  they 
examine  their  textbooks ,   and  perhaps  their  lectures ,  for  instances 
of  Important  information  not  explicitly  tied  by  a  relationship 
marker  to  other  information  in  the  text.    We  are  of  course  aware 
that  there  are  many  potential  uses  of  a  textbook  in  a  classroom 
and  as  many  ways  of  selecting  information  to  be  emphasized  and 
tested.    In  classrooms  where  the  teacher  generally  asks  very 
specific,  low  level  (detail)  questions  that  are  explicitly  slated 
in  the  text,  our  recommendations  will  not  suit.    However,  in  class- 
rooms where  tests  measure  how  well  students  are  getting  the  broad  . 
"picture"  of  a  topic,  and  where  they  are  expected  to  learn  from 
their  textbooks,  teachers  should  be  aware,  we  believe,  of  the 
special  difficulties  incurred  by  the  texts  they  assign, 

I     Experiment  4,  topic  continuity  and  cohesion  as  contrii»utors 
to  text  coherence.    High  school  students  were  employed  in  two 
different  procedures  to  test  aspects  of  cohesion  and  topic 
continuity  in  our  text  samples.    For  cohesion,  they  were  asked  to 
rate  the' ease  of  resolution  an4  the  importance  of| each  cohesive 
tie  in  a  text.    Results  indicated  that  in  each  of(  the  eight 
passages  submitted  to  this  analysis,  there  were  several  points 
that  were  considered  both  very  important  and  very  difficult  to 
resolve.    With  respect  to  topic  continuity,  the  students  W^re 
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asRed  to  rate  the  predictability  of  the  second  of  successive  pairs 
of  lideas  in  a  text.    Results  here  indicated  that  (a)  topic  discon- 
tininty  manifests  itself  frequently  in  informative  text,  (b)  as  a 
group,  the  Biology  texts  included  more  topic  shifts  and  more  points 
in  the  texts  that  students  rated  as  unpredi<:table,  (c)  discontinuity 
across  passages  was  detected  most  frequently  at  transitions  where 
the  connection  between  topics  was  either  weak  or  entirely  lacking, 
and  (d)  among  the  major  factors^ that  students  suggested  as  contri- 
buting to  discontinuity  was  the  authors*  failure  to  set  up  ^-j 
adequately  the  presentation  of  new  ideas. 

Experiment  5 patterns  of  text.    The  maps  of  the  30  sample 
texts,  serving  as  visual  displays  of  the  structure  of  ideas  and 
their  interrelatiooships ,  were  given  to  e^cpert  and  novice  text 
analysts  to  categorize.    The  instructions  simply  asked  the  subjects 
to  put  together  those  maps  that  seem  to  display  the  same  kind  of 
overall  structure.-   From  the  categofies  produced,  texts  were 
perceived  to  go  with  certain  other  texts  to  different  degrees. 
Clusters  of  texts  were  'found^that  we  labeled,  "description", 
"process"  or  "chronology",  "comparison",  and  a  fourth  category 
that  received  the  ungainly  label  of  "causal  description  of 
concepts." 

The  same  subjects  were  then  engaged  in  a  second  procedure 
that  involved  rating  the  degree  of  match  between  each  map  (text) 
and  each  of  the  four  category  labels  we  had  created  in  response 
to  the  "first  procedure.    Results  indicated  that  some  texts  were 
strongly  identified  as  being  of  one  type  (true  of  some  descriptive 
texts)  and  some  were  not  strongly  identified  with  any  of  Ifhe  . 
categories.    Comparison  and  process  texts  were  in^te resting  in  that 
both  showed  a  strong  identification  with  each  of  the  appropriate 
categories  as  wqII  as  a'^fairly  strong  identification  with 
description. 

We  concluded  from  our  results  that  the  concept  of  pure  text 
types  was  not  in' line  with  what  exists  in  naturalJ:y-Qccurring 
expository  texts*    True,  some  of  our  sample  texts  were  seen  as 
representing  clear  and  simple  patterns  of  "ideas.    Most,  however, 
seemed  to  be  perceived  as  hybrids  or  unclear  combinations  of 
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many  structural  relationships.    Thus  the  concept  of  "text  types" 
in:  informative  text  might  best  be  viewed  as  "text-typedness," 
replacing  a  categorical  concept  with  a  continuum. 

Experiment  6,  validating  the  concept  of  embeddedness.  One 
of  the  products  of  relational  mapping  is  a  derived  measure  of  the 
height  of  an  idea  in  the  structure  of  a  text  or  of  how  close  to 
the  main  topic  an  idea  is.    It  is  a  well  established  empirical 
finding  that  main  points,  important  ideas,  or  ideas  high  in  text 
structure  as  identified  by  various  other  means  are  likely  to  be 
remembered.    In  this  experiment,  we  hoped  to  establish  the  psycho- 
logical  validity  of  our  embeddedness  measure  and  to  identify  it 
as  similar  to  these  other  means  of  predicting  which  ideas  in 
discourse  are  most  memorable. 

College  undergraduates  were  asked  to  read  one  of  our  sarppje 
texts  and  then  to  rate  the  importance  of  a  set  of  sentences 
derived. from  the  text.    The  sentences  have  been  developed  to 
reflect  high  and  low  level  ideas,  stated  either  explicitly  or 
implicitly  in  the  text. 

Results  confirmed  our  expectations.  Sentences  identified  as 
high  level  as -a  result  of  relational  mapping  were  rated  as 
significantly  more  important  than  low  level  sentences,  thus 
providing  psychological  validity  to  our  text  analysis  system. 

Experiment  7,  individual  differences  in  learning  from  texts 
in  different  fields  of  study.    The  students  of  the  teachers  who 
had  identified  critical  portions  of  their  textbook  as  p3irt  of 
Experiment  2. above  were  presented  with  two  samples^^  from  their 
textbooks,  asked  to  read  and  learn  tKem,  to  produce  a  free  recall  , 
answer  short-answer  questions,  select  three  main  ideas  from  a  list 
of  eight  taken  from  the  text,  and  estimate  how  well  they  would 
and  had  understood  the  samples  as  well  as  how  well  they  had 
performed  on  the  learning  measures.    In  this  part  of  the  report, 
we  presented  data  relative  to  gender  and  fiel^of  study  differences 
in  the  recall,  mc^in  idea  Identification,  measure  and  the  first  two 
metacognition  measures.    Results  generally  indicated  that  there 
were  no  significant  differences  between  men  and  women  students 
in  terms  of  Teaming  measures.    There  were  some  differences  in 


the  metacognltion  ratings  but  these  went  counter  to  what  we  would 
have  predicted:  women  students  were  more  confident  when  learning 
Biology  and  men  more  confident  when  learning  History. 

Experiment  8,  learning  from  instructional  discourse  in  a  college 
geology   course >   As  a  dissertation  project,  one  of  our  students, 
Sarah  Ulerick,  extended  the  use  of  relational  mapping  to  describe  » 
the  lecture,  lab  manual  and  textbook  chapter  on  one  topic  being 
presented  as  part  of  a  true  instructional  setting,  an  Introductory 
geology  course.    She  found  that  she  could  use  mcipptng  as  the  basis 
for  identifying  occasions  where  two  or  more  of  the^  discourses  did 
and  did  not  agree  in  terms  of  the  structural  ties  surrounding  a 
particular  concept.    Where  there  was  apparent  disagreement,  inte- 
gration on  the  part  of  the  students  was^ called  for. 

The  major  findings  of  the  study  were  that  students  found  It 
relatively  easy  to  answer  questions  dealing  with  literal  explicit 
information.    They  had  much  more  -difficulty  answering  questions 
that  asked  them  to  integrate  concepts  across  discourse  boundaries. 

Experiment  9.  mapping  as  an  aid  in  helping  students  learn 
from  their  textbooks.    In  this  experiment,  we  attempted  to  Induce 
students  to  learn  more  from  their  textbooks  by  training  them  in 
the  use  of  mapping. as  a  form  of  summarizing  text  material.  College 
student's  were  assigned  to  a  trained  and  a  control  group  and  were 
measured  before  and  after  the  training  period.    Results  were 
generally  disappointing.    The  control  group  did  as  well  as  and  In 
some  cases  better  than  the  trained    group  and  all  students  did  not 
show  any  Improvement  on  the  posttest.    Perhaps  the  strategy  had 
not  been  learned  well  enough.    The  training  listed  a  total  of 
three  class  sessions,  which  may  not  have  been  long  enough  to 
produce  any  effect.    We  do  know  that  mapping  requires  a  relatively 
intense  and  effortful  commitment  on  the  part  of  the  learner.  It 
may  be  that  as  a  study  strategy,  it  is  doomed  to  failure  unles^ 
students  see  the  vaTiie  and  the  pay-off  for  their  extra  effort. 

Experiment  TQ,  investigating  a  topic/subtoptc  strategy  for 
improving  learning  from  text.    Again,  our  conclusions  from  an 
attempt  at  training  students  to  deal  more  effectively  with  their 
textbooks  were  equivocal  at  best.    Here,  one  of  our  students. 


Karen  Margolls,  as  part  of  her  dissertation,  trained  high  school 
students  to  identify  topics  and  subtopics  in  text  and  to  note  the 
relationship  that  held  between  them..  Although  there  seemed  to  be 
some  improvement  shown  in  students'  ability  as  they  were  being 
'trained,  the. effect  was  not  reflected  in  the  criterion  measure. 

Experiment  11.  the  learnability  of  ideal  texts  derived  from 
maps.    One  conclusion  to  be  drawn  from  the  results  obtained  as  a 
result  of  Experiments  2  through  5  described  in  Section  III  was 
that  textbook  authors  were  not  a|J<ays  as  helpful  as  they  might  be 
in  presenting  their  ideas  to  students.    In  this  experiment,  we 
set  out  to  rewrite  some  of  the  texts  from  our  sample,  using  the 
maps  made  of  the  original  texts  as  a  guide.    Since  a  map  represents 
explicitly  all  the  ideas  and  all  their  interrelationships  needed 
to  make  a  coherent  discussion  of  a  topic,  it  can  serv.^  as  a  guide 
to  producing  an  improved  version*  of  what  the  ajuthor  of  a  text 
must  have  intended  to  say.    In  addition,  we  were  interested  in 
the  effect  of  providing  students  with  study-guide  questions  that 
either  did  or  did  not  match  the  underlying  overall  organization 
of  ideas. 

J     Although  we  have  gathered  the  necessary  data  by  asking 
freshmen-level  college  students  to  learn  original  and  rewritten 
versions  of  two  of  our  sample  texts,  we  have  not  yet  scored  and 
analyzed  their  responses Major  questions  we  will  ask  of  the 
data  are:  (1)  Do  students  learn  more  from  texts  that  have  been 
rewritten  to  make  explicit  and  orderly  their  underlying  message 
"than  from  texts  in  their  original,  naturally  occurring  states? 
(2)  Do  students  learn  more  when  given  study-guide  questions  that 
match  the  overall  pattern  of  high-level  ideas  or  do  they  benefit 
when  given  a  different  perspective  on  the  text? 

Experiment  12.  the  effects  of  engineered  compare/contrast 
texts.    Four  versions  of  different  topics  were  compared,  all 
representing  types  of  comparison  texts.    In  one  version,  the  two 
objects  or  points  of  view  being  compared  were  kept'  separate  with 
the  discussion  of  one  appealing  first  before  the  discussion  of 
the  other.    In  another  version,  the  discussions  of  the  two 
concepts  were  integrated  point  by  point.    Each  of  these  two 
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structural  variations  were  then  written  either  with  explicit 
connectives  or  with  no  explicit  connectives.    High  school  students 
read  one  version  of  each  of  four  topics  and  produced  free  recalls 
following  each.  / 

Results  were  quite  clear.    Students  reading  the  intermixed/ 
versions  with  explicit  connectives  recalled  more  ideas;  included 
fewer  errors,  used  more  connectives,  and  more  of  these  students 
generated  some-  sort  of  resolution  of  the  contrasting  concepts 
being  presented.    In  light  of  these  findings,  we  feel  encouraged 
to  conclude  Jthat,  at  least  within  a  comparison  structure,  the 
engineering  of  text  will  have  a  significant  effect  on  what  students 
do  with  the  texts. 
Theoretical  Papers 

In  addition  to  the  experiments  and  methodological  tools  we 
developed,  we  produced  theoretical  critiques  of  methods  of  text 
analysis.    These  appear  in  Section  IV,  Parts  2  and  3.    The  major 
point  we  make  in  these  critiques  is  that  existing  systems  of  text 
analysis  run  the  danger  of  being  used  to  talk  about  texts  as  ^having 
Invjiriant  structures.    We  argue  that  text  analysis  systems  are 
best  viewed  as  research  tools  to  help  investigators  describe  texts 
and  as  such,  reflect  the  text  analyst's  own  understanding  of  the 
text  rather  than  some  inherent  feature  of  text. 
Conclusion  1 

We  believe  we  have  come  a  long  way  since  we  began  in  describing 
the  nature  of  textbook  language  and  of  how  students  learn  from 
their  textbooks.    We  know  a  great  deal  particularly  about  those 
30  300-word  selections  taken  from  secondary  level  Biology  and 
History  textbooks  that  became  the  basis  of  materials  in  nine  of 
the  twelve  exeriTOnts  we  conducted.    We  believe  that  many  of^our 
conclusions  are  of  potential  interest  to  other  researchers 
interes,^,  in  how  people  learn,  how  they  learn  from  text,  and  how 
authors  write.    The  producers  of  textbooks,  authors  and  editors 
alike,  may  want  to  consider  our  findings  in  future  editions. 
Finally  educators  may  be  encouraged  to  take  special  tactics  in 
helping  their  students  understand  their  textbook  authors* 
message. 
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Appendix  A 
Survey  Administered  to  Texas  Students 
(refer  to  Section  II) 


Print  your  miMlm  mm  and  iMt 
l«tt«r  of  your  last  nmmmt 


Qrmdmt 
Aaot 

ClM«  yon  mrm  in  right  now 
(givo  noM  of  taaohor  and  tiaa)  t 


STODY  SUHVgX 


DIBSCnOHSt    Rattt  thm  following  items  by  placing  a  ch«ck  b«loir  tho 

appropriate,  nuaibor.  Tha  nombara  correapond  to  tha  £ol loving 
labalat 


1 

navar 


alalat 
aavar 


ilioaa 


4 

almoat 
alwaya 


5 

alwaya 


X«    Hhmn  you  raad  a  olUptar  in  your  taxtbooJc,  to  what  axtant  do  you  uaa 
tha  following  mathoda  of  atudyt 


1) 


navar 

1 


al  OuaLiuuL  m  aotlinaOi)  for  liiftinraHon  in 
tha  GhBtars 


b)  tUca 

c)  TMoa 

d)  ' 
a) 


idiHa  you 


tfaa  chaptar? 
tha  <  lM|tfair7 
In  tbi 


nd/or  OBvliata  activitiaa 
psovidad  in  tfaa  chuptaai^ 


f)  Attaqpt  to 


of  tha  chaptjar? 


g)  BMd  tha  ctapCK^noo^  ooly  onoa  (without 
or  I wftira  w^pa^plDg  tof  othar  activitiaar 
a.g.  notataldng^  outlinlog^  undflrlixiing)?  . 


h)  nneaad  tha 


i)  Aak  yoursalf 
to#  during  MUfoc 


tiZOM? 


ibont  tha  cfaaptar  otiar 
raiding? 


j)  Aak  tha  taachar  to  awplain  tha  wtlra  chvter 
or  pnrtinna  of  it? 


k)  Aak  othHT  atudita  to  aiplaln  tha  «tlxa 
or  pqprfnna  of  it? 


tha  «tita 
wLtii  othai  a? 


or  portlona  of  it 


m)  RHd  tha  «tlza 

n) 


or  poEtiona  of  it  aloud? 
bafiota  baglxnlng  your 

laadlng  of  tha  chi^tar? 

o)  Ravlaw  thaitiwdlngs  givan  for  ch^ptar  ■ubaactlau 
bafofja  hatfbiiliy  your  rMdlhg  of'  tha  chiptar? 


p)  HMd  othar 
tha  dti^star? 


en  tha  tapLo(a)  ooroatad  in 


ilwaya 

S 


• 
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I.    (cont'd)  Mh«n  you  rmmd  «  ehaptsr  in  your  textbook ,  to  what  Mtsnt  do 
you  us«  th«  following  tuthods  of  study t 

nm^x  always 
1         2         3         4  5 


p)  fm^  ottar  mntam  on  tte  taplobi)  copmd  in 


q)  in  yoor  owi  mte  thi  ctai^tK  or  porticna 

of  it? 


r)  Ud&k  ataut  itet  you  do  nd  do  not  tacrir  abaut  tha 
mdin? 


topic  bafon  rmaug  tfaa  ehupttf? 


a)  nana  apaoif^  «y  »VI1t1nnai  nadnda  of  ituly  you  uaa  i 


II «    Bow  oftan  do  you  find  a  chapter  in  your  taxtttook  difficult  to 


ondttratand  bao«ua«t 

^mabolaxy  ^idA  im  difficult  to 

not  elaarly  point  out  tha  oaln  Idaaa? 

you  to  knov  nora  about  itet  you 
ara  xaadlng  ttm  you  do? 

or 


natar 

1  2 


alvaya 

5 


b) 

d 


d)  tta  tpn  doaa  not  provlda  nough 
olarffiraHfln  STkay  idaaa? 

/  a)  Iha  tnt  la  poorly  orgnljad  ^  that  la,  tba  taxt 
la  writtan  in  a  lay  wUjch  la  difficult  to  fioUoi^ 

fT  ]Sha  tBCt  doaa  no^^rofida  anffldant  IntnoAiotQcy 
or  li'l^Kuid  In?hnwit1cn 
IdaM? 


gl  Tba  tast  doav  wt  atta^t  to  zalat^i  idaaa  to  vftiat 
you  alcaai^  taw  about  ttia  topio? 


hi  Tha 

not 


il 


not 


ia  ou^"af«data  -  th^  la,  tha  \mxt 
eoaant 


 Ixxalavant  Infoomatian  t^ilch  la 

to  thaparpoaa  far  idiich  tfaa  taoct  la 


j)  Tim  taxt  doaa  not  point  out  Isportnt  r^Lationahlpa 


k)  'Om  taxt  doaa  not  Inoluda  a  good  aumcy  of  tha 
rft^ttar? 


1)  ISia 


m)  Tha  taxt 

jOor  voor 


got  cooar  aa  nxch  of  tfaa  topic  aa  tfaa 
you  to 

Into  nora  <1at^tT  thn  la  ipiicopriata 


'* 

I 

« 

} 

i 

I 
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If  you  hmvm  any  othu  infornuitlon  which  mAy  hm  rttlavax^  to  any 
•tmgthfl  or  woaknossos  of  tha  tutbook,  plaMosppocify  t 


APMT  neOH  THPgy  ABPir  ABOOT  WHICH  YOOv  HAVg  Bggf  QOgOTIOHEPt 

Dosorlbo  thoso  upMts  of  your  tMtbook  which  mako  it  difficult 
for  s^ou  to  road  and  undor stand  a  chaptors 


I 

Doaortba  thoao  aspaots  of  your  taxtbook  which  halp,  aaaiat  or 
iiaka  it  aaaiar  for  you  to  raad  and  undaratand  a  chaptart 


2  '\  ^ 


DZRSCTZOMS: 


a  1 
a  lot  of 
difficulty 


Rata  tha  follovlxi^  Itama  by  placing  a  chack  balow  tha 
appropriata  humbar.    Tha  nunibmxs  corraapond  to  tha 
following  labala: 


soma 

difficulty 


occaaional 
difficulty 


raraly  any 

difficulty 


navar  any 

difficulty 


IZZ*^  Wh'an  you  raad  a  chaptar  in  your  taxtbool^r  to  what  aaitant  do  you  hava 
difficulty  with  aach  of  tha  following: 


a)  Idsxtlfying  Jsportint 


bl  Itettfying  ralaHmahlpa 
tha 


in  tiv  chaptK? 

in 


e)  ttMWiHaiMtfary  difficult  wrahnlnryy 
dl  tetMpLaling  diagr— »  graptaa,  ate.? 


a)  OanatXQcting  m  nntHna  far  tha  infooiBtlGD 
in  tfia 


^ha  chflptar? 


f)  TMug  notaa  %<iilaiyoa 


g)  Mdng  nofa  aftar  you  hawa  raad  tha  cfaiptar? 

h)  Simrlrtng  Urn  chifitar  in  your  an  worda? 


1)  Q«ianrt±Q9  quaaticna  to  guida  yoir  zaading  of 
tha  duptK? 


j)  Anawidng  gnaatinna  or  caqplating  activitiaa  tha 
haa  pEDvldad? 


\)  AnsMaring  qoaatlGna  or  ocniptl^ating  activitiaa  tha 
haa  ptuvidad? 


1)  Ptaparing  for  an  asoai  or  quiz? 

n)  Ouiwjiny  your  zaading  rata  (alci]iining«  praviawing, 
raadtog  alowly}  witii  ^^our  iAu.iJuaa  for  reading  and 
aypa  of  matanal  you  ara  reading? 

n)  RtaOMing  how  Mil       haRia  aithar  wdarstood  or 
niiaiiirtaLatJDLxi  idiat  you  bkva  raad? 

dl  KhoNdn?  how  wall  you  will  ba  abla  to  iwiwijat' 
Miat  ^  hava  raad? 


pi  Baianijaiing  ytoat,  you  hava  raad  a  day  latar? 
q)  Snoharin^  ^kbat  you  hava  raad  a  waak  latar? 
r)  Oaooaatxating  aa  you  raad  tha;  chi^tar? 


1 

2 

3 

4 

5 

f 
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It  you  h«v«  any  oth«r  information  which  may  b«  relevant  to  any 
strangths  and  waaknassaa  you  may  hava  dealing  with  chapters 
in  the  textbook r  please  specify: 


MPOtt^FR^  WHICH  YOP  HAVg  BEEN  QOBSTIONgD: 

Describe  the  types  of  difficulties  which  you  have  when  you 
read  ^  chapter  im  your  text: 


Describe  any  difficulties  that  you  have  when  you  prepare  for 
an  exam  on  a  particular  chapter:  , 
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Appendix  B 
Survey  Administered  to  Illinois  Students 
(refer  to  Sectix)n  II) 


ERIC  . 
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Print  your  middle  name  and  last 

letter  of  your  last  name:_^  

Sex :  ' 
Grade: 


Date  of  birth: 


Month/day/year 
Class  you  are  in  right  now 

(give  name  of  teacher  and'time)_ 
School: 
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PART  I 

DIRECTIONS!    Please  read  and  circle  a  response  for  each  Item  below. 
^  Choose  only  one  response  for  each  Item. 

When  you  study  a  chapter  in  your  textbook,  how  often  do  you 
use  the  following  methods? 

I.    outline  the  Ideas  in  the  chapter  ^ 


never  sometimes  almost  always 

always 


2.     take  ndtes  from  what  you  have  read  in  the  chapter 


never  somet  imes  a  I  most  a  I  ways 

always 


3.     underline  Important  ideas  in  the  chapter 


neve  r  somet  imes  a  I mos  t  a  I  ways 

always 


summarize  in  your  own  words  the  chapter  or  parts  of  it 

never  sometimes  almost  always 

always 


5.    answer  the  quest ions^g iven  in  the  text  or  complete  the 
activities  you  find  included 


never  somet  imes  almost  always 

always 


6.     try  to  memorize  important  parts  of  the  chapter 


never         '  somet  imes  almost  always 

always 
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7.    pause  to  think  ^^bout  what  you  do  and  do  not  know  about  the 
topic  of  the  chapter  before  you  begin  to  read 

never  sometimes  almost  always 

always 


8.    ask  yourself  questions  about  ideas  in  the  chapter 


never  sometimes  almost  always 

always 

9.     review  all  of  the  headings  given  in  the  chapter  before  you 
begin  to  read  the  chapter 

* 

never  sometimes.        almost  always 

always 


lOJ.     read  a  chapter  summary  before  you  begin  to  read  the  chapter 


never  sometimes  almost  always 

^  always 


11.     read  the  chapter  through  only  once  (without  doing  or  before 
you  do  any  notetaking,  outlining,  under  1 i n i ng  etc. ) 

neve  r  some  times  almost  al way  s 

a  1  ways 


12.    reread  the  chapter  several  times 


ERIC 


never  somet  imes  almost  always 

always 


3.     read  the  entire  chapter  or  parts  of  it  aloud  to  yourself 


never  sometimes  almost  always 

always 


Jo 


3 


ask  the  teacher  to  explain  the  ent  i  re  chapter  or  parts  of  It 


never  sometimes  almost  always 

always 


\  15.    ask  other  students  to  help  explain  the  entire  chapter  or  parts 

"  of  It 

never  sometimes  almost  always 

" — -X  always 

16.  discuss  the  entire  chapter  or  parts  of  it  with  others 

ne ve  r  some  times  almost  al way  s 

always 

17.  read  other  books  on  the  topic(s)  discussed  in  the  chapter 


never  sometimes  almost  always 

always 


13.     Describe  step  by  step  how  you  study  a  textbook  chapter. 

Be  sure  to  Include  any  additional  methods  of  study  you  use 
which  were  not  mentioned  above. 
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PART  II 

DIRECTIONS:    Please  read  and  circle  a  response  for  each  item  below. 
^  Choose  only  one  response  for  each  item. 

How  of  ten  do  you  find  that  the  following  are  problems  which 
make  your  textbook  dl f f Icul t  to  understand? 

1.     the  text  uses  words  which  are  difficult  to  understand 


never  sometimes       almost  always 

a  problem       a  problem       always  a  problem 

a  problem 


2.     the  text  does  not  tell  you  which  ideas  in  the  chapter  are 
important;   that  Is,  which  ideas  you  should  remember 


never  sometimes       almost  always 

a  problem       a  problem       always  a  problem 

a  problem 


3.     the  text  does  not  tell  you  how  one  important  idea  is  related 
to  another  important  idea. 


never  sometimes       alrrost  always 

a  problem       a  problem       always  a  prq^blem 

a  problem 


k.     the  text  does  not  explain  how  new  ideas  are  related  to  things 
you  a  I  ready  know 


never  sometimes       almost  always 

a  problem       a  problem       always  a  problem 

a  problem 


5.     the  text  organizes  ideas  in  a  way  which  is  difficult  to  follow 


never  sometimes       almost  always 

a  problem       a  problem       always  a  problem 

a  problem 
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6,     the  text  does  not  Include  enough  background  information 
before  it  discusses  new  ideas 


never  sometimes  almost  always 

a  |)rob1em       a  problem  always  a  problem 

a  problem 


7,     the  text  does  not  include  enough  examples  to  help  you 
understand  new  ideas. 


never  some  t  i  mes  a  1 mos  t  a  1  ways 

a  problem       a  problem  always  a  problem 

a  problem 


8,     the  text  does  not  include  a  good  summary  of  the  important 
ideas  in  the  chapter 


ne  V  e  r  some  times  almost  always 

a  problem       a  problem  always  a  problem 

a  problem 


the  text  expects  you  to  know  more  about  what  you  are  reading 
than  you  usual ly  do 


never  sometimes  almost  always 

a  problem       a  problem  always  a  problem 

a  problem 

J  • 

10,     the  text  does  not^  discuss  as  many  of  the  ideas  as  the  teacher 
expects  you  to  know 


never  sometimes  almost  always 

a  problem       a  problem  always  a  problem 

a  problem 


11,     the  text  spends  too  much  time  discussing  ideas  the  teacher 
does  not  expect  you  to  know 


never  sometimes  almost  always 

a  problem       a  problem  always  a  problem 

a  problem 


6 


12.    the  text  Is  out-of-date--that  Is,  the  text  does  not 
discuss  current  issues 


never  sometimes       almost  always 

a  problem       a  problem       always  a  problem 

a  probl  em 


13.    Please  describe  any  other  strengths  and  weaknesses  of  your 
textbook* 


Strengths 


Weaknesses 
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PART  III 
DIRECTIONS: 


Please  read  and  circle  a  response  for  each  item  below.  Choose 
OQly  one  response  for  each  Item. 

When  you  study  a  chapter  In  your  textbook,  how  d I ff icul t  Is 
I t  for  you  to: 

I.     Identify  Important  ideas  in  the  chapter 


5ry  sometifnes       hardly  ever  never 

ifflcult       difficult        difficult  difficult 


2.     identify  how  important  ideas  are  related 


very  somet  imes 

difficult  difficult 


hardly  ever  never 
difficult  difficult 


3.     understand  difficult  words 


very  sometimes       hardly  ever  (:never 

diff icul t       diff icul t       diff Icul t  diff Icul t 


k.    understand  diagrams,  graphs,  etc. 


very  sometimes       hardly  ever  never 

d  i  f  f  I  cul  t       d  i  f  f  i  cult        d  i  f  f  i  cu  l^t  difficult 


5.    outline  the  information  In  the  chapter 


very  sometimes       hardly  ever  never 

diff icul t        diff Icul t        diff Icul t  di  ff icul t 


6.     take  notes  from  what  yqu  read  in  the  chapter 


very  sometimes       hardly  ever  never 

difficult       difficult        difficult  dlffijijjlt 


7.  summarize  the  chapter  In  y9?lr  own  words 

very  sometimes      , hardly  ever  never 

difficult       difficult       difficult     _  difficult 

8.  think  of  questions  to  ask  yourself  about  what  you  are  reading 

very  sometimes       hardly  ev6r  '  never 

I    difficult       difficult       dif>lcult^  difficulty 

9.  recall  something  yoiJ  already  know  that  will  relate  to  what  . 
you  are  reading  - 

-  very  sometimes       hardly  ever  never 

difficult       difficult     '  difficult  difficult 

10.    answer  the  questions  or  complete  the  activities  included 
in  the  chapter 


very  sometimes       hardly  evir  never 

difficult       difficult       difficult/  difficult 


II.    answer  the  questions  or  complete  the  a/tivi ties  the  teacher 
has  provided 


very  sometimes       hard/y  ever  never 

difficult       difficult       dif/icult  difficult 

12.  change  your    reading  rate  (skimn/ing,  pre^gwing,  reading 
slowly)  with  your  purpose  for  /eading  and  type  of  material 
you  are  reading 


,very  sometime/       hardly  ever  never 

difficult       difficu/t       difficult  difficult 


13.    prepare  for  an  exam  of  qui"2 


very  sbmetimes       hardly  ever  never 

difficult     /difficult     .  difficult     ^  difficult 
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1^.    know  how  well  you  have  either  understood  or  misunderstood 
what  you  have  read 


very  sometimes       hardly  ever    '  never 

difficult       diff Icul t       diff  Icul t  diff Icul t 


15.  know  how  well  you  will  be  able  to  remember  what  you  have  read 

V  ■ 

very  .  somet Ime«^,^    hardly  ever  never 

'       difficult       diff Icul  tN  diff  Icul t  difficult 

16.  remember  what  you  have  rea^  a  day  later  ' 


very  sometimes       hardly  ever  never 

difficult       difficult       difficult  difficult 


17.  'remember  what  you  have  read  a  week  later 


very  sometimes       hardlyever  never 

difficult       difficult       difficult  difficult 


18.    concentrate  as  you  read  the  chapter 


19. 


ver'y  sometimes       hardly  e\>er 

difficult   ■    difficult  difficult 


never 
diff  I 


{ 

Icult  \ 

Please  describe  any  other  difficulties  you  have  when  you 
study  a  chapter  In  your  text. 




t 
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DIR^TIONS:    Please  read  and  circle  a  response  for  each  I  tern  below.  Choose 
-  ^  only  one  response  for  each  i  teta. 

L I  s^"ed"beTow  a  re  things  your  teacher  may  do  someft  Imes      th  your 
te'ltbook.     Indicate  whether  you  would  agree  that  It  is  important 
that  your  teacher  do  the  following.  < 

1.  spend  more  time" explaining  the  chapter  before  I  read  it 

strongly  agree  'disagree  strongly 

'  agree  '        disagree  . 

2.  go  over  the  chapter  in  class  before  a  test 

strongly  agree  disagree  strongly 

agree  "  disagree  , 

3.  tell  me  which  'ideas  in  the  chapter  I  should  rerapmber  I 

strongly  agree  disagree   •  strongly 

agree        .  •  disagree 

^4.    explain  how  new  Idevas  are  related  to  things  I  already  know 

% 

strongly  agree  disagree  strongly 


agree 


4 


disagree 


5.    explain  the  difficult  words  in  the  chapter 

strongly  agree  disagree  strongly 


agree 


disagree 


e  chapter^a 


6-    discuss  Information  which  the  chapter  "as  not  covered 


s  t  rong ) y  agree  d I sagree  s  t  rong 1 y 

agree  disagree 


t-i; 


7.  '    provide  n\e  an  overview  oi;"out1ine  oiF  the  chapter 

J         *        "StrongJy    "      agree         *  disagree  strongjy 
'     agree'  ^  .  disagree 

8.  prov r<ie  questions  to  guide  my  refading  of  the  chapter  , 

strongly  agree  -disagree  strongly 

.      .  "    agree  disagree 

3*    provide  additioiial  material  to  read  (handouts,  books,  etc.) 

strongly  agree    „        disagre^e  strongly 

agree  .     ^.     .    '  disagree 

10.  giVe^me  time  in  class  to  read  the  text 

'  Strongly  agree  disagree       ^  strongly' 

agree  '  -  disagree 

11.  let  me  read  the  text  for  myself  instead  of  making  reading 
ass  ignments  ' 

*  '  ** " 

strongly  agree  disagree  strongly 

^  agree  .  disagree 

'  12.    give  students  time  in  class  to  get  together  and  discuss 

the  ideas  in  the  text 


strongly  agree  disagree  strongly 

agree  '  "  d  i  sagree 


13.    assign  additional  activities  to'^help  me  understand  the 
ideas  in  the  chapter 


strongly  agree  disagree  strongly 

agree     ^  *  disagree 


Or' 

ERIC  .  > 
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14.    teach  me  how  to  find  out  which  ideas  in  the  chapter  are 
important  -  '    ^  ^ 


strongly 
agree 


jvagree 


disagree 


strongly 
di  sagree 


15.     teach  me  how  to  find  out  whether  one  important  idea  is 
related  to  another 


strongly 
agree 


agree 


di  sagree. 


strongly 
d  i  sagree 


16.    spend  time  teaching  read i ng- ski  1 1  s  (skimming,  previewing) 


strongly 
agree 


agree 


di  sagree 


strongly 
di  sagree 


17.     spend  time  teaching  study  ski  1 1 s  (notetaking,  outlining, 
summarizing)  ^  " 


strongly 
agree  - 


agree 


disagree 


strongly 
di  sagree 


18.    use  a  textbcJok  which  is  easier  to  read 


strongly 
agree 


agree 


disagree 


strongly 
d  i sagree 


19.    use  a  textbook  which  is  more  interesting  to  rfeacf 

agree  d  i  sagree 


strongly 
agree 


strong  ly^ 
disagree 


26V    use  a  textbook  which  i s  more"  up-to-date 


strongly 
agree 


agree 


d  i  sagree 


strongly 
di  sagree 


ERLC 
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21.    not  use  the  textbook  at  all 


strongly 
agree  . 


agree 


di  sagree 


strongly 
d I sagree 


22,    Please  describe  anythinig  else  you  would  suggest  the  teacher 
might  do  to  help  you  study  a  chapter  in  your  text. 


2i0 


ERIC 


APPENDIX  C 

TABLES  RELEVANT  TO  SECONDARY  STUDENTS'  USE  OF 
SOCIAL  STUDIES  AND  BIOLOGY  TEXTS 
(refer  to  Section  II) 


Table  3A: 

Texas  Students'  Responses  to  Survey:  Part  I 
Frequency  of  Response 
(Almost  Never,  Sometimes,  Almost  Always,  Always) 


1. 

complete  textbook  questions/activities 

(79%) 

2. 

memorize  portions  of  chapter 

'  (67%) 

3. 

read  chapter  through  once 

(66%) 

4. 

review  subheadings 

(57%) 

5. 

evaluate  extent  of  poor  knowledge 

(50%) 

6. 

discuss  chapter  with  others 

(48%) 

7.' 

reread  chapter  several  times 

(48%) 

8. 

self-questioning 

(47%) 

9. 

summarize  the  chapter 

(45%) 

10. 

ask  teacher  to  explain 

« 

(44%) 

11 . 

underlining 

(43%) 

12. 

read  chapter  summary 

(39%) 

13. 

notetaking  after  reading  chapter 

(38%) 

14. 

notetaking  while  reading 

(34%) 

15. 

ask  other  students  to  explain 

(34%) 

16. 

read  other  sources 

(30%) 

17. 

read  the  chapter  aloud 

(24%) 

18. 

construct  an  outline 

(16%) 

RIC 


TABLE  3B 

Texas  Students'  Responses  to  Survey:    Part  I 


Question 


Hean 


Standard 

Devi  at  ion 


Never 


Almost 
Never 


Some  t  Idles 


Almost 
Always 


Always 


I.  Construct  anoutllnc{s)  for 
information  In  the  chapter. 


2»  Talte  notes  whi  le  you  read  27S 
the  chapter. 

3.  Take  notes  after  you  read        ^  275 
the  chapter. 

U.  Underline  selected  leas  In  "  275 
Che  chapter. 

5.  Answer  questions  and/or  27^ 
complete  activities  provided 

in  the  chapter. 

6.  Attempt  to  memorize  portions  276 
of  the  chapter. 

7.  Read  the  chapter  through  only  275 
once  (without  or  before  engag- 
ing any  other  activities,  e.g., 
notetaklng,  outlining,  under- 
lining). 

8.  Reread  the  chapter  several  273 
t  imes . 

9-  Ask  yourself  questions  about  276 
the  chapter  prior  to,  during 
iin^tox  after  reading. 


I.5'*I8 

2.1782 
2.2327 
3  J825 

2.9  275 
3.0327 

2.**  396 
2. '(601 


.82<«5 
1.1279 
I.l<t98 
I .2099 

I  .OI'43 

1 . 19**^ 
1 . 19'«l 

1 .083** 
1.0897 


.6<4 

(176) 

(113) 

.37 
(102) 

39 

(108) 

.07 
(18) 


.15 
('*2) 

.  1 1 
(31) 


.23 
(6M 

.22 
(60) 


.20 
(56) 

.25 
(69) 

.25 
(69) 

.18 
('•9) 

(39) 


.18 
(51) 

.23 
(62) 


.29 
(79) 

.31 
(87) 


(38) 

.2<i 
(65) 

.25 
(69) 

.28 
(78) 

.'•3 
(119) 


.36 

(98) 

.31 
(85) 


.31 
(8^*) 

.30 
(82) 


.01 
(3) 

.06 
(16) 

.08 
(23) 

.10 
(26) 

.26 
(71) 


.20 
(55) 

.22 
(61) 


.I** 
(38) 

.13 
(36) 


:of 

(2) 

.Oil 
(12) 

.05 
(12) 

.05 

.10 

(27) 


.11 
(30) 

.13 
(36) 


.03 
(8) 

.Oti 
(11) 
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TABLE  3B  (continued) 


Question 


Mean 


Standard 
Deviation 


Never 


Almost 
Hever 


Somet  Imes 


Almost 
Always 


Always 


10.  Ask  the  teacher  to  explain  27**  2.3577 

the  entire  chapter  or 
portions  of  It. 

Tl  .  Ask  other  students  to  explain        276  2.0290 
entire  chapter  or  portions 
of  It.  .  ^ 

12.  Discuss  the  entire  chaptc^r  or        275  2.'*2|8 
portions  of  It  with  others. 

13.  Read  the  entire  chapter  or  273  l.82'*2 
portions  of  it  aloud. 

1*1.  Read  a  chapter  sumnary  before        27^  2.2591 
beginning  your  reading  of  the 
chapter . 

15.  Review  the  headings  given  for        275  2.7^36 
chapter  subsecilons  before 

beginning  your  reading  of  ihc 
chapter . 

16.  Read  other  sources  on  the  276  2.0906 
topic(s)  covered  In  the 

chapter . 

17.  SuiTiTWjrIze   in  your  own  words  273  2. '♦103 
the  chapter  or  portions  of  it, 

|8.  Think  about  what  you  do  and  do      272  2.5^^*1 
not  know  about  the  topic 
'  before  reading  the  chapter, 


I  .0672 
1 .0122 

1.1058 
1 .0668 
1 .1838 

1.2638 

.9737 

1.0915 
1.1126 


.26 
(70) 


.^0 
(110) 


,25 
(69) 

(I'*6) 

(9M 


.19 
(53) 


.3J 
(86) 


.2^* 
(65) 

.19 
(53) 


.30 
(83) 


.26 
(72) 


.27 

(7^ 

.22 
(61) 

.27 
(73) 


.2t« 
(65) 


.39 
(108) 


.31 
(85) 

.31 

(83) 


.29 
(81) 


.26 

(73) 


.33 
(91) 

.l<« 
(39) 

.2*3 
(62) 


.31 
(86) 


.21 

(57) 


.29 
(79) 

.32 
(87) 


J2 
(33) 


.07 
(18) 


.11 
(29) 

.D8 
(22) 

.  II 
(32) 


.13 
(36) 


.08 
(21) 


.12 
(3M 

.12 
(33) 


.0^3 
(7) 


.01 

(3) 


.0<4 

(12) 

.02 
(5) 

.05 
(13) 


.13 

(35) 


.01 


.0^ 
(10) 

.06 
(16) 


Table  4A 

Illinois  Students'  Responses  to  Survey:  Part  I 
Frequency  of  Response 
(Sometimes,  Almost  Always,  Always) 


1.  memorize, portions  of  chapters  (91%)  V 

2.  complete \textbook  questions/activities  (82%) 

3.  discuss  Chapter  with  others  (82%) 

4.  notetaking      \     *  (77%) 

5.  ask  teacher  to^explain  (76%) 

6.  read  the  chapter  through  once  (74%) 

7.  self-questioning  (72%) 

8.  ask  other  students*to  explain  (65%) 

9.  summarize  the  chapter  (64%) 

10.  evaluate  extent  of  poor  knowledge   ^  (62%) 

11.  reread  chapter  several  times  (60%) 

12.  underlining  .(56%)* 

13.  construct  an  outline  (56%) 

14.  review  headings  (56%) 

15.  read  chapter  sumnary  ^^(55%) 

16.  read  chapter  aloud  (47%) 

17.  read  other  sources  ,  (25.5%) 


9q 
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TABLE  4  B 


Illinois  Students*  Responses  to  Survey 
Part  I 


Standard 
Deviation 

1 

2 

3 

Question 

Mean 

never  a 
problem 

sonetlmes 
a  problem 

althost 
alwaysi  a 
ptipbleni 

always 
a  problem 

1 . 

Out;line  the  ideas   in  the 
chapter 

1^ .  706 1 

♦  .7^50 

(153) 

'  .kh 
(152) 

A 

(33) 

.02 

(9) 

2  . 

Take  notes,  from  what  you 
have  read  in  the  chapter 

2.0893 

.8'402 

.23 

(81) 

.52 
(181) 

.17 
(58) 

.08 

(27) 

3. 

Underline  important  ideas 
in  the  chapter 

1 .80^0 

.8579 

(153) 

.36 

(12'4) 

.16 
(55) 

.Ok 
(15) 

Summarize  in  your  own  words 
the  chapter  or  parts  of  i  t 

1  .86^46 

.8270 

.36 
(126) 

.146 
(161) 

.12 

.06 

'  (19) 

5. 

Answer  the  questions  given 
in  the  text  or  complete  the 
activities  you  find  included 

2.1758 

■  18 
-—^162) 

.51 

(178) 

.26 

(91) 

.05 
(i6) 

6 . 

Try  to  memorize  important 
parts  of  the  chapter 

2.7061 

•  937^ 

.09 
(32) 

.35 
(122) 

.32 
(109) 

.  Ik 

\  m  • 

7. 

Pause  to  think  about  what 
you  do  and  do  not  know  about 
the  topic  of  the  chapter 
before  you  begin  to  read 

1 .858B 

.8330 

.38 
(131) 

M 
(151) 

,  ('*8) 

.05 

8. 

Ask  yourself  questions  about 
ideas   in  the  chapter 

2.01^^ 

.82  75 

.28 
(97) 

.i»8 
(167) 

.18 
(6M 

.06 

(19) 

9. 

r.  ■ 

Review  all   the  headings 
given  in  the  chapter  before 
you  begin  to  read  the  chapter 

1 .90^9 

.9882 

(151) 

.33 
(MM 

» 

.  1-3 
('*6) 

.  10 

,(36) 

25a 


TABLE  4B  (continued) 


Question 


10.  Read  the  chapter  summary 
before  you  begin  to  read 
the  chapter 


1) 
12 

13 
1^ 


Read  the  chapter  through 
only  once  .  > 

Reread  the  chapter  several 
t  imes 


Read  the  Entire  chapter  or 
parts  of  it  aloud  to  yourself 

Ask  the  teacher  to  explain 
the  entire  chapter  or  parts"^ 
of  i  t^ 

15,  Ask  other  students  to  help 
explain  ttie  entire  chapter 
or  parts  of  it 

16.  Discuss  the  entire  chapter 
or  parts  of  it  with  others 

17.1  Read  other  books  on  the 
topic(s)  discussed  in  the 
chapter 


Mean 


1.9335 

2.2939 
I  .8329 

I .6398 

1 .9653 

1 .7752 

? .0922 
1 .2738' 


Standard 
Deviation 


1  .051^1 

13 
.8i»71 
.7301' 
.7093 

".6725 
.i»898 


never  a  sometimes  a 
problem  problem 


.30 

(1561^' 

'  (lOi*) 

- 

.26 

- 

.  37 

(88) 

(129) 

.kO 

.kl 

(139) 

.53 

.33 

(183) 

(116) 

.2k 

.59 

(82) 

(205) 

.35  . 

.55 

(120)= 

(191) 

.18 

.60 

(6M 

*  (2b7) 

.'7'»3 

"  .  .Ikl 

(258) 

(8M 

almost 


always, a 
roblem 


.11 

(39) 

.20 
(70) 

.12 

{k^) 

.  II 

(38) 

AM 
(^♦8) 


.09. 
(30) 


(5I) 
.012 

(M 


always  a 
problem 


.17 
(60) 

.06' 

(19) 

.03 
(10) 

.03 
(11) 

.01 

(6) 

.06 
(20) 

.003 
"(I) 


/ 


Note.     The  question  was  'When  you  study  a 

actual  number   is   in  parenthesis 
^    N  -=  3'«6  \ 

25  J 
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Table  5 

Texas.  Frequency  of  Response  by  Subjects 


Biology 

History 

1  • 

'  complete'  textbook  questions/activities 

\/0%) 

1 . 

complete  textDOOK  questi<jns/aCLi vi  Lies 

read  the  chapter  through  once 

\o7%) 

<> 
c . 

memorize  portions  ot  cnapter  . 

\  t^ro) 

3. 

fnemorize  portions  of  chapter  ^ 

/  C  Oct/  \ 

3. 

read  the  chapter  through  once 

4. 

review  headings 

(55%) 

A 

4. 

review  headings 

\007o) 

5. 

evaluate  extent  of  prior  knowledge 

/  AOo/  \ 

(4o^) 

c 

uiscuss  cnapter  witn  otners 

•  \  OU/o  } 

6. 

se^f-questioning  , 

/  A  CO/  \ 

(46%) 

6. 

reread  chapter  several  times  . 

I  i;Q<y  ^ 
voy/o) 

7. 

reread  chapter  several  times 

/  A  AO/  \ 

(44%) 

/. 

summarize  the  chapter 

o 
O. 

''discuss  chapter  with  others 

f  A  AO/  \ 

(44/b) 

Q 

n. 

eva 1 uate  extent  ot  poor  Know i eoge 

9. 

undierlining 

/  AOo/  \ 

(42%) 

ask  teacher  to  explain. 

10. 

ask  teacher  to  explain  . 

f  AOO/  \ 

(42/o)- 

1  n 
lU. 

sel  f-ques  itioni  ng 

11 

(41%) 

11  . 

read  chaoter  summarv 

(46%) 

12. 

read  chapter  summary 

(37%) 

12. 

underlining 

(45%) 

13. 

notetaking  after  reading  chapter 

(37%) 

13. 

read  the  chapter  aloud 

(42%) 

14. 

*  notetaking  while  reading 

(33%)  ° 

14? 

ask  other  Students  to  explain 

(40%) 

15. 

ask  other  students  to  exfxlain 

(32%) 

15. 

notetaking  after  reading  chapter 

(39%) 

16. 

read  other  sources 

(29%) 

16. 

■  It 

notetaking  while  reading  ^ 

(37%) 

17. 

read  chapter  aloud 

(18%)  ^ 

17. 

read  other  sources 

(32%) 

la. 

construct  an  outline  ^ 

(13%) 

18. 

construct  an  outline^B^ 

(24%) 

Texas-Part  r;      TABLE  5B 


Difference  between  Biology  &  +Hi story 

1 : 

^cau  undf/Lcr  a  i  uuu  > 

2. 

u  1  dCUdd' unap Lcr  wiLn  ULficrd 

\  ^  1  0/0 

■  3. 

\^  1  0/0 

activities 

4. 

Reread  chapter  several  times 

•  (+15% 

5. 

Summarize  the  chapter 

(+14% 

6;. 

Memorize  portions  of  chapter  - 

•(+12% 

7. 

Construct  an  outline  -  " 

(+11% 

8- 

Ask  teacher  to  explain 

(+09% 

Read  chapter  summary 

(+09% 

10. 

Review  subheadings 

(+08% 

11. 

Ask  other  students  to*  explain 

(+08% 

12. 

Evaluate  extent  of  prior  knowledge 

(+06% 

P- 

Notetaking  while  reading 

(+04% 

14, 

Underlining            ,  i 

(+03% 

15. 

Sel  f-questioning"  ' 

(+03% 

16. 

Read  other  sources 

(+03% 

17, 

Read  the  chapter  through  once 

(+03% 

18. 

Notetaking  after  reading  chapter 

(+02% 

2UJ 


TABLE  5C 

Texas  Students'  Responses  to  Part  I:    Biology  &  History 


He  an 


, Ques  t i  on 


Standard 
Dey I  a  t  i  on 


Never 


Almost 
Never 


Sometimes 


Almost 
Always 


Always 


B 

H 

H 

B 

H 

B 

H 

B 

H 

B 

H 

B 

H 

B» 

H 

1. 

Cons  true t, an  outline (s)  for 
Information  in  the  chapter.. 

20k 

71 

—  I. — 
1  .<i706 

K 

7'»65 

.7586 

.9669 

.67 
(137) 

.55 
(39) 

.20 
{k\) 

.21 
(15) 

.12 

(2k) 

.2ff 

.005 
(1) 

.b3  ^ 

(2) 

.005 
(1) 

.01 
(1) 

2. 

Take  notes  whl  le  you  read 
the  chapter.  ^ 

20k 

71 

2.03'*3 

2. 

1631 

1 .0662 

1 .2907 

(83) 

(30) 

.27 

.21 

(15) 

.25 
(50) 

.21 
(15) 

.05 
(M) 

.07 
(5) 

.03 
(6) 

.09 

(6) 

3. 

Take  notes  after  you  read 
the  chapter. 

20k 

71 

2.  iBl'i 

2. 

1690 

1 .1708 

1  .0953 

37 
\  /b ) 

.37 

.26 

.  21 

(n\ 
\*  / ) 

.25 

.  2 

.0/ 

1 1 
•  1 1 

(8) 

nc 
(11) 

0 1 
(1  ) 

i». 

Underline  selected  Tdeas  in 
the  chapter. 

205 

70" 

2.22kk 

2 

2571 
5857 

1 .2120 

1.2121 

.kO 
(81 ) 

.39 
(27) 

.18 
(38) 

.16 
(II) 

.27 
(55) 

.33 
(23) 

.(0 
(21 ) 

.07 

(5)  < 

.05 

( \f\\ 
[  lO) 

.05 

(L\ 

5. 

Answer  questions  and/or 
complece  activities  provided 
in  the  chapter. 

20^ 

70 

3.0'*'«1 

3 

1 .0088 

.92'»6 

.08 
(  Id  ) 

.03. 

(2 ) 

•  J  7 

.07 

.'•7 

33 

.20 

.08 

(17) 

.iV 

(10) 

6. 

Mtferr.pt   to  memorize  portions 
of  the  chapter. 

205. 

71 

2.B3'*I 

3 

.1972 

I  .*20I2 

I  .  I'*I7 

.18 
(37) 

.07 
(5) 

.19  * 

(38) 

.18 
(13) 

(70) 

.kO 
(28) 

.20 
('•2) 

.18 
(13) 

.09 
(18) 

.17 

(12) 

7. 

Read  the  chapter  through  only 
once   (without  or  before  engag 

20k 

71 

3.0|i*7 

^.OSkS 

1. 1931 

1 .20'*l 

.12 
(25) 

.09 
(6) 

.21 
(^♦3) 

.27 
(19) 

.32 
(65) 

.28 
(20) 

.23 
('•6) 

.21 
(15) 

.12 
(25) 

.15 
(H) 

inq  any  other  activities,  e.g 

notetaking.  outlining^  under- 

8. 

lining). 

Reread  thfe  chapter  several 
t  i  mes  1      '  - 

203 

70 

2.37'*'* 

I 

.6286 

1,056/ 

\  .\k'k^ 

.2k 
{k3) 

.21 
(15) 

.32 
(65) 

.20 

(iM 

.28 
(57) 

.39 
(27) 

.]k 
(28) 

J** 
(10) 

.02 

ik) 

.06 

(M, 

9. 

Ask  yourself  questions  about 
the  chapter  prior   to,  during 

205 

71 

2, '♦537 

2 

.^♦789 

I .  lO**** 

I  .0537 

.22 
(^6) 

.20 

(iM 

32 

(65) 

.31 

(22) 

.28 
(57) 

.35 
(25) 

,\k 
(29) 

.  10 

(7) 

.Ok  . 

(3) 

.Oil 

(3) 

and/or  aftclr  reridifig. 


TABLE  5C  (continued) 


-^ean 


Question 


Standard 
Oeviat  ion 


Never 


Almost 
Never 


^  Somet  imes 


Almost 
Always 


10.  AsIc  the^teacher  to  explain 
the  entire^  chapter  or 
portions  of  it. 


205     69    2.2829    2.5797    1.0280  1.1556 


II.  Ask  other  students  to  explaip  205 
entire  chapter  or  portions  ^ 
of  i  t . 


71     1.9707    2.1972  1.0190 


.9801 


chapter.  i 

15.  Review  the  headings  given  for  20k      71    2.7059    2.9296    1.2601     1.2686  .20 
chapter  subsections  before  ('.2) 
beginning  your  reading  of  the     '  . 

chapter. 

16.  Read  other  sources  on  the         205^^    71    2.0927    2.08'»5       9682      .996i»  .30 
topic  (s)  covered  in  the  -  (62) 
chapter.               '                          .  ' 


.16 
(II) 


(2M 


.25  '  *  .21 
(50)  (15) 


(8M  (2M 


.30  .3*1 
(62)  (2ti) 


.20  .2k 
ikO)  (17) 


.13  .I** 
(26)  (10) 


.08  .07 
(16)  (5) 


17-  Summarize  in  your  own  words  202 
the  chapter  or  portions  of  It. 


71    2.3<tl6    2.6056    1.0823    1. 1017  .26 


''1.8.  Thinly  about  what  you  do  and  do202      70    2.<*90l     2.7000     1.0521     1.2666  .19 
not  icnow  about  the  topic  (38) 
before  reading  the  chapter. 


Always 


.27  .20  .31  .29  .30  .29  .11  .16  .01 
(56)     {\k)      (63)     (20)      (61)  (20) 


(22)     (II)  (3) 


.'•3  .30  .25  ^30  .2*1  .3'*  .07  05  .01 
(89)     (21)      (51)     (21)      ('•9)     (2i.)      (\k)     ik)  (2) 


.12 
(2M 


.01 
(3) 


.06 

(M 


.01 

(I) 


12. 

Discuss  the  entire  chapter  or 
portions  of  it  with  others. 

205 

70 

2.3122 

2 

7'»29 

1.0665 

1.1633 

.28 
(57) 

.17 
(12) 

.28 
(58) 

.23 
(16) 

.32 
(65) 

.37 
(26) 

.09 
(19) 

.\k 
(10) 

.03 
(6) 

.09 
(6) 

13. 

Read  the  entire  chapter  or 
portions  of  it  aloud. 

202/ 

71 

1 .6832 

2 

.225'* 

.9561 

1.2558 

'.57 
(116) 

(30) 

.25 
(50) 

.16 
(II) 

.11 
(22) 

(17) 

.06 
(12) 

Ak 
(10) 

.01 
(2). 

.Ok 
(3) 

111. 

Read  a  chapter  summary  before 
beginning  your  reading  of  the 

201* 

70 

2.1569 

2 

.5571 

1.1^68 

1  .2ti69 

.38 
(78) 

.23 
(16) 

.25 
(51) 

.31 
(22) 

.23 

(W) 

.21 
05) 

.10 
(21) 

.16 
(11) 

,0k 
(7) 

.09 
(6) 

.15 
(II) 


.01 

(I) 


.18 
(13) 

.33 
(66) 

..27 
^(19) 

.26 
(53) 

36 
(26) 

.12 
(25) 

.13 
(9) 

.03 
(6) 

.06 
(M 

.22 
(IS) 

.33 
(66) 

.2't 
(17) 

.3'. 
(68) 

.27 
(19) 

.10 
(21) 

.17 
(12) 

.01* 
(9) 

.  10 
(7) 

ERIC 
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ILLINOIS  -  PART  I 


Table 


Biology 


1 

1  . 

COnipictc    LcSLDpOK   ^  Ucb  L  1  Uilb/ au  L  i  V  I  U  1  c  o 

9 

Qiscuss  criapLer  wiLn  ounerb 

J. 

asK  teacher  lo  explain 

4  . 

reao  cnapLer  Lnr ougn  once 

r 

b . 

notetaking 

0  . 

fnemorize  portions  of  chapter 

\  OU  A)  ) 

asK  otner  bLUucni-b  lu  cApiain 

o 

o. 

reread  cnapter  several  Linies 

\  /  D/o  ) 

9. 

self-questioning 

(70%) 

10. 

summarize  the  chapter 

(63%) 

11. 

evaluate  extent  of  prior  knowledge 

(58%) 

12. 

read  chapter  aloud 

(55%) 

13. 

construct  an  outline 

(51.1%) 

14. 

review  subheadings 

(50%) 

15. 

underlining 

(48%) 

16. 

read  chapter  summary 

(42%) 

17. 

read  other  sources 

(26%) 

ERIC 


OK  3 


'V 


History 

 ^  T 


1 . 

memorize  portions  of  chapter 

(91%) 

2. 

reread  chapter 

(86%) 

3. 

discuss  chapter  with  others 

(79%) 

4. 

complete  textbook  questions/ 

activities 

(77%) 

5. 

notetaking. 

(74%) 

6. 

self-questioning 

(74%) 

7. 

ask  teacher  to  explain 

(72%) 

8. 

read  chapter  through  once 

(71%) 

9. 

evaluate  extent  of  prior  know- 
ledge 

(65%) 

10. 

summarize  the  chapter 

(64%) 

11 . 

read  chapter  summary  . 

(64%) 

12. 

underl ining 

(61%) 

13. 

review  subheadings 

(61%) 

14. 

construct  an  outline 

(61%) 

15. 

ask  other  students  to  explain 

(56%) 

16. 

read  chapter  aloud 

(42%') 

17. 

read  other  sources 

(25%) 

Illinois:    Part  I 


TABLE  SB 


Difference  between  Biology  and  History 


1 . 

ask  other  students  to  explain 

2\ 

read  chapt*er  summary 

3. 

read  chapter  aloud 

4. 

underlining 

\^\ Oh) 

5. 

complete  textbook  questions/activities 

/  '  T  0<V  \ 
\''\C%) 

6. 

memorize  portions  of  chapter 

^  7. 

review  subheadings 

\^\  Mo) 

8. 

reread  the  chapter  several  times 

( A,^A°f  \ 

\^\  \h>) 

9. 

ask  teacher  to  explain 

<  (-11%) 

10. 

read  chapter  through  once 

(-10%) 

11. 

construct  an  outline 

(+08.9%) 

12. 

notetaking 

(-07%) 

13. 

evaluate  extent  of  prior  knowledge 

(-06%) 

14. 

discuss  chapter  with  others 

(+04%) 

15. 

self-questioning 

(+01%) 

16. 

sunmiarize  the  chapter 

(+01%) 

17. 

read  other  sources 

(-01%) 

TABLE  6C  ; 


Illinois  Students*  Responses  to  Part  I:    Biology  &  History 


^         ,         Standard     i  ^ 

"  J                Mean                  Deviation                1                    2                    3        "  ^ 
Question  -         ^   


\ 

B 

H 

B 

H 

B 

H 

B 

H 

B 

H 

1 . 

Outline  the  ideas   in  the ^ 
chapter 

1  .5874 

,1 

.7892 

.6/427 

.8001 

.489 
(70) 

.40 
(83) 

.441 
(63) 

.44 
(89) 

.063 
(9) 

.  12 
(24) 

.007 
(1). 

.04 
(8) 

2 . 

Take  notes  from  what  you 
have  read  in  the  chapter 

2.  1608 

2 

.0392 

,  .8529  ■ 

.8295 

f 

.  19 

(28) 

.26 

(53) 

.55 
(78) 

.51 
(103) 

.16 

(23) 

.17 
(35) 

.  10 
(14) 

.06 
(13) 

3. 

Underline  important  ideas 
in  the  chapter 

1  .73^43 

1 

.8529 

,.903'* 

.8233 

.52 
(74) 

.39 
(79) 

.29 
(41) 

.41 
(83) 

.14 

(20)  ' 

.17 
(35) 

.05 
(8) 

.03 
(7) 

k . 

Summarize  in  your  own  words 
the  chapter  or,  parts  of  it 

1  . 8801 

1 

.  8^80 

.  86m8 

0      1  1 

.37 

(53) 

.  3d 
(73) 

(62) 

ti  ft 

(■99) 

(19)' 

1  1 
.  1  1 

(22) 

.  UD 

(9) 

(10) 

5. 

Answer  the  questions  given 
in  the  text  or  complete  the 
activities  you  find  included 

2 . 2867, 

2 

.0980 

.7375 

.  7880 

.  1  1 
(16) 

.23 
(46) 

.55 
(78) 

.49 
(100) 

.  29 
(41) 

•(50j 

(8) 

(8) 

6. 

Try  to  memorize  important 
parts  of  the  chapter 

2.8i*62 

,2 

.6078 

.9222 

.09 
(13). 

.09 
(19) 

.26 

(37) 

.4.2 
(0-5) 

,■25 
(52) 

.28 

(5/ ) 

.29 

(Li  \ 

.21 

\^  i  1 

7. 

r 

Pause  to  think  about  what 
you  do  and  do  not  knov;  about 
the  topic  of  the  chapter 
before  you  begin  to  read 

1  .8182 

1 

.8873 

.8528 

.8197 

.42 
(60) 

•35 

-(7!) 

.39 
(56) 

.46  ' 
(95) 

.14" 

(20)^ 

.14 
(28) 

.05 
(7) 

„05 
(10) 

8. 

Ask  yourself  ques  t  i  ons-^^ou  t 
ideas   in  the  chapter. 

1  ,9790 

2 

.0392 

.8262 

.8295 

.30 
(43) 

"  .26 

(.54) 

.47 
(67) 

.49 
(100) 

.18 
(26) 

.19 

(38) 

.05 

(7) 

.06 

(12) 

9. 

Review  all   the  headings 
given  in  the  chapter  before 
you  be,gin  to  read  the  chapter 

1 .7203 

2 

.03'*3 

.8992 

1 ,0286 

.50 
(72) 

.39 
(79) 

.35 
(50) 

.31 
(64) 

.07 
(10) 

.18 
(36) 

.08 
(11) 

,12 
(25) 

ERIC  ^^"^  ' 


TABLE  6C  (continued) 


Standard 

ji 

r 

(Question 

Mean^ 

Deviat 

on 

2 

3 

1, 

B 

H 

B 

H 

B 

H 

B 

H 

— 4^ 

H 

1  0 

-' —  ■  r  

before  yo'u  begin  to  read 
the  chapter 

1 

6713 

2.1182 

.9625 

1  .07'4'4 

.58 
(83) 

.36 
(73) 

.27 
(38) 

.33 
(66) 

.05 
(8) 

..15 
(30 

.  10 
(iM 

.16 
(33) 

1 1 . 

Read  the  chapter  through^^ 
only  once 

2 

5105 

2  .  1  '422 

1 .0606 

.98/48 

.19 

(28) 

.29 
(60) 

m 

.  ko 

(81) 

.23 
(33) 

.  1 8 
(37) 

(3M 

.  1 3 

(26) 

12  . 

Reread  rhe  chapter  several 

t'  1  end*  C 

2 

.Ok20 

1 .6863 

.8125 

.8/420 

.25 
(36) 

.50 
(103) 

.51 
(73) 

.36 

(73) 

.18 
(26) 

.08 
0(17) 

.06 

(8) 

.06 
(11) 

13. 

Read  the  entire  chapter  or 
parts  of   it  aloud  to  yourself 

1 

.7552 

1 .5588 

8326 

.  750/4 

./45 

(65) 

.58 
(118) 

.3fi 

(5^4) 

.30 
(62) 

.13 

(18) 

.  10 
(20) 

.0/4 
(6) 

.02 

{^) 

Ask  the  teacher  to  explain 
cne  en  CI  re  cnapter  or  pares 
of  i  t 

Ask  other  students   to  help 
explain  the  entire  chapter 
or  parts  of  it 

2 

.okso 

1 .SOSk 

.67/48 

.7286 

.17 

(25) 

.28 

(57) 

.63 

(90) 

.56 
(115) 

.17 

(2/4) 

.  12 
(2/4) 

.03 
C^) 

.0/4 
(7) 

15. 

1 

1 .6569 

.6255 

.680/4 

.21 
(30) 

.kk 
(90) 

.65 
(93) 

(98) 

.13 

(18) 

> 

.06  , 
02) 

.01 
(2) 

.02 
(M 

16. 

Discuss  the  entire  chapter 
or  parts  of   it  with  others 

2 

.1329 

2 .0637 

.79^6 

.15 
(21) 

.2  1 

(^^3) 

.61 

(87) 

.59 
(120) 

.21 
(30)' 

.13 

(26) 

.03 

(5) 

.07 
05) 

17. 

Read  other  books  on  the 
topic(s)  discussed  in  the 

1 

.2797 

1 . 2696 

.k807  ■ 

(105) 

.75 
(153) 

.25 
(36) 

.235 
(^♦8) 

.01 
(2) 

.01 

(2) 

.00 

(•0) 

.005 
(1) 

chtjpter 


f  Jo  t  e 


y 

b 
c 
d 

e 


The  question  was  ''When  you  study  a  chapter  in  your  textbook  how  often  do  you  use  the  following  methods? 


N  =  3'*7 

n  =  1/43.   .'^1  \ 
n  -  20^  .  .59 
actual  number 
N  =  3^*6 


6  in  parenthesis 


271 


Texas  Part  I  ,        TABLE  6F 

Difference  between  History  Females  and  Biology  Females 


1. 

read  chapter  aloud 

(+27%) 

2. 

discuss  chapter  aloud 

(+25%) 

3. 

coFfiplete  chapter  questions/activities" 

(+22%) 

4. 

construct  an  outline 

+19%) 

5. 

review  subheadings 

A      ^  to 

(+14%) 

5V 

reread -the  chapter  several  times 

(+13%) 

■  7. 

ft 

evaluate  extent  of  prior  knowledge 

,(+12°4, 

% 

memorize  portions  of  the  chapter 

(+11%) 

9. 

reread  chapter  summary 

(+10%). 

10. 

sel f-questioning 

. (+09%) 

n. 

summarize  the  chapter 

(+09%) 

12. 

read  the  chapter  through  once 

(+08%) 

13. 

ask 'other  students  to  'explain^ 

(+08%) 

14- 

notetaking  while  reading 

(+05%) 

15. 

notetakipg  after  reading  chapter 

(t03%) 

16 . 

underlining  \ 

(+03%) 

17. 

ask  the  teacher  to  explain 

(+02%) 

18.. 

read  other  sources 

(+01%) 

11 

I 

12. 

i;}. 

14. 

If- 
If. 


Male 


'  TABLE  7A  , 

Texas  Students  Response  to  (Jart  I: 
Mek>le  &  Female 


Female 


complete  textbook  questions/activities 

(80%) 

1. 

complete  textbook  questions/activities 

(78%) 

memorize  port i 0^5  of  the  chapter 

(73%) 

2. 

read,  chapter  through  once 

(62%) 

read  chapter  through  once 

(71%) 

3. 

memorize  portions  of  the  chapter 

(61%) 

review  subheadings                         ^  - 

(56%) 

4. 

review  subheadings 

(57%) 

evaluate  extent  of  prior  knowledge 

(53%) 

5. 

reread  chapter  several  tifnes 

(52%) 

self-questioning  ^ 

(51%) 

6. 

underlining 

(49%) 

summarize  the  chapter 

(43%) 

7. 

ask  teacher  to  explain 

(48%) 

rereiad  chapter  several  times  » 

(43%) 

8. 

discuss  chapter  with  others 

(47%) 

ask  teacher  to  explain 

(40%) 

9. 

,  summarize  the  chapter 

(47%) 

notetaking  after  reading  chapter^ 
discuss  chapter  with  others 

(39%) 

lo! 

evaluate  extent  of  prior  knowledge 

(47%) 

(39%) 

11. 

\^lf-questioning 

(43%) 

underlining 

(37%) 

12. 

read  chapter  summary 

(41%) 

read  chapter  supiary  . 

(37%) 

13. 

"notetaking  while  reading 

(39%) 

read  other  sources     ;  . 

(33%)" 

14. 

notetaking  after  reading  chapter  , 

(38%) 

asK  other  students  to  explain 

(30%) 

15. 

ask  other  students  to  explain 

(37%) 

'Hotetaking  while  reading^ 

(29%) 

16. 

read  .other  sources 

(27%) 

read  "chapter  aloud  / 

(23%) 

17. 

read  chapter  alou(f 

J  26%) 

construct  ao  outline    \   "  ■  '  '  . 

(18%) 

18. 

construct  an  outline 

ll4%) 

FRir 


277. 


Texas:    Part  I     :     ^    TABLE  7B 

Difference  between  Male  and' Female 


.  .1.'  Memorize  portions  of  the  chapter  '  (+12%) 

^       2.  ^  underlining                                   ,  ^  (-1.2%) 

3.  notetaking  while  reading  ,  (-10%) 

4.  read  the  chapter  through  once  (+09%) 
.5.    reread  the  chapter  several  times    ~  "  (-09%) 

6.    self-questioning     ^              •  (+08%) 

7\    ask  the'teacher  to  explain  (-08%) 

8,  discuss  the  chapter  with  others  (-08%) 

9.  ask  other  students  to  explain  (-a7%)  * 

10.  read  other  sources  (+06%)- 

11.  evaluate  extent  of  prior  knowledge  '  (+06%) 
1*2.  construct  an  outline  (+04%) 
13-:'  sumna'rize  the  chapter  (-04%) 

14.  read  the  chapter  summary  (-04%) 

15.  '  read  the  chapter  aloud  (-03%) 

16.  complete  textbook  questions. activities  (+02%) 
^  17.    notetaking  after  reading  the"Wapter  (+01%) 

18.    revi^  chapter  subheadings  ,  (-01%) 


ERLC 
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TA^7C 

Texas  Students V Responses  to  Part  I: 


Male  &  Female 


Mean 


Quest  ion 


Standard 
Deviation 


Never 


Almost 
Never 


Somet  Imes 


Almost 
Always 


Always 


M  F* 


1.  Construct  an  outllne(s)  for 
information  In  the  chapter. 

2.  Take  notes' while  you  read 


the  chapter.  ^  ^ 

3.  Take  notes  after  you  read 
.  the  chapter . 

k.  Underline  selected  Jdeas  in 
the  chapter- 

5.  Answer  'ques t  ions  and/or 
complete  act  i  v  i  t  ies"^  provided 
in  the  chapter. 

6.  Attempt  to  memorize  portions 
of  the  chapter . 

7.  Read  the  chapter  through  only 
once  (without  or  before  engag 
ing  any  other  activities,  e.g 
notetalcing,  outlining,  under- 
lining)*. 

8.  Reread  the  chapter  several 
times. 

9.  Ask  yourself  questions  about 
the  chripler  prior  to,  durlTig 
and/or  ,)ficr  reading. 


129  1^6  1.5581  \.S27k 

129  1^6  1.9767  2.1575 

129  1^6  2.2016  2.1575 

129  I '♦6  2.0775  2.3699 

128,  ius  3.1719  3.1918 

130  \U(>  3.0i462  2.8219 

129  1^6  3.0853  2.9863 

130  \k3  2.3615  2.5105 
130    \U  2.5231  2.k0k\ 


.8188  .8321 

1 .0859  1 .1608 

|.|ii|ii  1. 1608 

1 .1633  1 .237'* 

.9890  I .0393 

1 .1197  1 .2522 

I  .1728  I  .2I'*8 


(82)  (9M 

.^♦3  .39 

(56)  (57) 

.3^  .39 

(^♦5)  (57) 

M  .3A 

(58)  (50) 

.06  .07 

(8)  (10) 


.12 


,10 


.18 


12 


.18  .22 

{2k)  <32) 

.28  .22 

(36)  (33) 

.27  .23 

(35)  (3M 

.18  .17 

(23)  (26) 

.\k  .15 

(18)  (21) 


.15 
(20) 

.19 


.21 
(31) 

.26 


0606 

.25 

.22 

.32 

.26 

(33) 

(31) 

(^♦2) 

(37) 

1720 

.16 

.27 

.33 

.30 

(21) 

(39) 

(^♦3) 

m 

M 

F 

M 

F 

M  * 

F 

.16 
(21) 

.12^ 
(17) 

.02 

(2) 

.01 
(1) 

.00 
(0) 

.01 

(2) 

.20 
\2b} 

.27 

U9  J 

"  .05 
\bi 

.07 

.ok 

•  .05- 
(7) 

.26 
(33) 

.zs 

(36) 

.08 
(10) 

.09 
(»3,) 

.05 
(6) 

(6) 

.25 
(32) 

.32 
(^♦6) 

.09 
(12) 

.10 

(IM 

.03 
(M 

.07 
(10) 

(57) 

(62) 

.27 
(3M 

.25 
(37) 

•  09 
(11) 

1  1 
.  1  1 

(16) 

(52) 

.32 
(^♦6) 

.23 
(30) 

.17 
(25)- 

.10 

(13) 

.12 
(17) 

.^♦0 
(51) 

.23 
(3*^) 

.16 
(21) 

.28^ 
(^♦0) 

.15 
(20) 

.1  1 
(16) 

.28 
(36) 

(^♦8) 

.10 
0  3) 

.17 
(25) 

•  OS 
(6) 

.01 
(2) 

.36 
(^6) 

,25 
(36) 

.13 
(17) 

.13 
(19) 

.02 
(3) 

.05 

(8) 

2-7.3 


ERIC 
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TABLE  7C  (continued) 


Mean 


Question 


Standard 
Devtat Ion 


Never 


Almost 
Never 


Somet  Imes 


Almost 
Always 


Always 


M 

F 

M 

F 

M 

F 

M 

F 

H 

F 

.25 
(32) 

.26 
(,3"8) 

.35 
(1.5) 

.26 
(38) 

.29 
(38) 

•  30 
CS) 

.09 
(12) 

.15 
(21) 

.02  ' 
(2) 

.03 

(5) 

.It5 
(58) 

36 
(52) 

.25 
(32) 

.27 
CiO) 

"25 
(32) 

.28 

.03 
(5) 

.09 

(13)  . 

.02 
(3) 

.00 
(0) 

.25 
(33) 

.25 
(36)' 

.26 
(3'«) 

.28 

,35 
('«5) 

.32 
('«6) 

.11 
(III) 

.10 

.03 

(^) 

.05 
(B) 

.55 
(72) 

.5* 

(71.) 

.22 
(28) 

.23 
(33) 

.15 
(19) 

.  |l< 
(20) 

.07 
(9) 

.09 
(13) 

.01 
(1) 

.03 
C) 

36 
('•6) 

33 

('•81 

.27 
(35) 

.Zd 
(38) 

.21) 
(32) 

.21 
(30) 

.09 
(11) 

. \k 
(21) 

.0*1 
(5) 

.06 
(8) 

.  18 
(23) 

.21 
(30) 

.  26 
(33) 

.  22 
(32) 

.  32 
('«2) 

.  30 
CI.) 

.  1  z 
(16) 

lie 

.  135 
(20) 

(15) 

(201 

•  30 
(39) 

.32 
('.7) 

.37 
('«8) 

(60) 

.23 
(30) 

.19 
(27) 

.09 
,  (12) 

.06 
(9) 

.01 
(1) 

.02 
(3) 

.22 
(29) 

.25 
(36) 

.35 
('«5) 

.28 

m) 

30 

(38) 

.28 
Cil) 

.11 

(IM 

.|l< 

(20) 

.02 
(2) 

.05 
(8) 

.20 
(26) 

.19 
(27) 

.27 
(3'.) 

.3't 
('•9) 

.36  • 
(hi.) 

.28 
Cil) 

.  10 
(13) 

.|l< 
(2Q) 

.07  - 
(9) 

(? 

.05 
(7) 

10.  Ask  the  teacher  to  explain 
the  entire  chapter  or 
port  Ions  of  1 1  * 


129    1^5    2.2791    2.ii276      .9920  1.1288 


II.  Ask  other  students  to  explain  130 
entire  chapter  or  portions 
of  It. 


12.  Discuss  the 
port  Ions 


he  ent  I  r^^ 
of  1 t  wl tn 


chapter  or  130 
others . 


13.  Read  the  entire  chapter  or 
portions  of  It  aloud. 


129 


I'l.  Read  a  chapter  sunvnary  before  129 
beginning  your  reading  of  the 
chapter . 

15.  Review  the  headings  given  forN29 
chapter  subsections  before 
beginning  your  reading  of  , the 
chapter. 

1 6.  Read  other  sources  on  the  130 
topic(s)  covered  in  the 
chapter . 

17.  Summarize  in  your  own  words  128 
the  chapter  or  portions  of  it. 


1 8.  Think  about  what  you  do  and 
do  not  know  about  the  topic 
before  reading  the  chapter. 


128 


|li6    1.9^62    2.1027    1  .0291 


.99W 


1^5    2.<iOOO  2.kk\k  1.075^  1.1358 

\kk    1.7519  1.8889  1.0002  1.1226 

v. 

\ks  2.1783  2.3310  1.1281  1.2307 

lli6    2.7^^*2  2.7808  1.2265  1.2998 

|ii6    2.1385  2.0*179  .9785  .9708 


\h5    2.3359  Z.^7S3 


.9982    1  .1672 


2.5703    2.5208    1.13'<2^  1.0965 


2b  2 


Texas  Part  I  TABLE  7D 

Biology 

Difference  between  Males  and  Females 


1  . 

C  • 

iiiciiiuri^c  puruiUMb  ui    lfic  i^Fiaptci  ^ 

(-♦•13^^) 

\  '  \  ^  to  f 

0  . 

unuc  r 1 1 n 1 

(-11^^^ 

H  . 

/*han'^oi^  cdwov*a1  '^'{fnoc 

t: 

• 

• 

^  ( -11 

/ . 

uuiibtruut  an  uut  i  i  ric  . 

(  +  10^^ 

\     \  \J  to  f 

o 

o . 

nu tc tdK 1 ny  wni ic  rcauiny 

q 

evaluate  cA.tcnu  Ui  .priUi  Isnuvvicuvjc 

10 . 

complete  textbook. questions/  activities 

11. 

ask  other  students  to  explain 

(-07%) 

12. 

discuss  chapter  with  others  .  ^ 

(+07%) 

13. 

summarize  the  "chapter  "  ^ 

(-07%) 

14. 

read  other  sources 

(+04%) 

15. 

notetakin^  after  reading  chapter 

(-03%) 

16. 

read  chapter  summary  ' 

(-03%) 

17. 

review  subheadings 

(+03%) 

18. 

read  chapter  aloud 

(-01%) 

9 


D 


Texas  Part  I  TABLE  7E 

History 

'  Difference  between  Males  and  Females 

V 


1 

1  . 

^  '  1  U  A*  / 

c  . 

UlbLUbb    Lrlc    LFiapUci    W  1  I'll  UUilcid 

'7 
o  • 

lIU  LC  LQN  1  il^    Wll  lie  iCaUlM^ 

f  il  '^t) 

A 

H  . 

nuucudiNin^  diLcr  rcduiii^  LiiapLcr 

t: 

LUiiipicuc   Liiapuci    t|UC,b  U  1  UMb  /  a  U  U  1  V  1  L  1 

f-in^ ^ 

V  "  1  U  A)  1 

D  • 

real]   ULiicr  bUUiLcb 

f  +1 ^ 

7 

unuci  i 1 n 1 

\  ""U  J  A)  } 

Q 
O  . 

rcVlcW  bUUilcau  1  n^b 

^  ""UZ7>b  1 

9. 

construct  an  outline 

(-07%) 

10. 

reread  the  chapter  severeil  times 

(-07%) 

11. 

read  the  chapter  through  once 

(-06%) 

12. 

read  the  chapter  aloud 

(-06%j 

13. 

ask  the  teacher  to  explain 

1+05%) 

14. 

read  chapter, summary 

1-05%) 

15. 

ask  other  students  to  explain 

(-04%) 

16. 

evaluate  extent  of  prior  knowledge 

1-04%) 

17. 

self-questioning 

(-02%) 

18. 

summarize  the  chapter 

■  ■  > 

(+01%) 

fexas  Part  I  TABLE  7F 

Difference  between  History  Males  and  Biology  Males 


1 . 

read  the  chapter  aloud 

(+22%) 

2. 

ask  the  teacher  to  explain 

[+18%) 

3. 

reread  the  chapter  several  times 

(+17%) 

4. 

summarise  the  chapter 

(+17%) 

5. 

memorize  portions  of  the  chapter 

(+14%) 

6. 

read  the  chapter  through  once 

(-14%) 

7. 

ask  other  students  to  explain 

(+11%) 

8. 

notetaking  after  reading  the  chapter 

(+10%) 

9. 

read  chapter  summary 

(+08%) 

10. 

.read  other  sources 

(+07%) 

11 . 

underlining 

(+05%) 

12. 

complete  textbook  questions/activities 

(+05%), 

13. 

self-questioning 

(-04%) 

14. 

discuss  the  chapter  with  others 

(+04%) 

15. 

construct  an  outline  ' 

(+02%) 

16. 

'  review  subheadings 

{+02%)- 

17. 

notetaking  while  reading  . 

(+01%) 

18. 

evaluate  extent  of  prior  knowledge 

(-01%) 

Illinois 


TABLE 


MALE   . 

1.  memorize  portions  of  chapter  (90%) 

2.  ^complete  textbook  questions/activities  (82%) 

3.  read  chapter  through  once  (82%) 

4.  discuss  chapter  with  others  (76%) 

5.  notet^king  (74%) 

6.  self-qiiestibning  (73%) 

7.  ask  teacher  to  explain  ^  (73%) 

8.  summarize  the  chapter  (65%) 

9.  evaluate  extent  of  prior  knowledge  (61%) 

10.  read  chapter  summary  -  (59%) 

11.  ask  other  students  to  explain  (59%) 

12.  reread  the  chapter  several  times  (58%) 

13.  construct  an  outlined  (58%) 

14.  review  subheadings  (56%) 

15.  underlining  (52%)^ 

16.  read  chapter  aloud  (34%) 

17.  read  other  sources      -  (33.3%) 


1^  '.  

FEMALE 


1 

memorize  portions  of  chapter 

191%) 

o 

c . 

discuss  chapter  with  others 

T  . 

* 

(86*) 

3. 

complete  textbook  questions/acti vitie>/ 

(83%) 

4. 

notetaking          .  ' 

(79%) 

c 

J- 

ask  teacher  to  explain 

( 79% ) 

6. 

^  read  chapter  through  once 

(73%) 

7. 

ask  other  students  to  explain 

(72%) 

8. 

self-questiomng 

(72%)/ 

9. 

evaluate  extent  of  prj^or  knowledge  . 

(63%) 

10. 

summarize  chapter  | 

i 

(62%) 

reread  chapter 

(62«) 

12. 

* 

underlining 

(59%) 

13. 

read*  chapter  aloud 

(58%) 

14. 

review  subheadings 

(57%) 

15. 

construct  an  outline 

(54%)  ' 

>6. 

read  chapter  summary' 

(51%) 

17. 

read  other  sources 

(18.7%) 

o 


min&is  TABLE  8B 

Difference  between  Male  and  Female  ^  ^ 

.  *% 

1.  read  chapter  aloud  {^1^%) 

2.  read  other  .sources  (-14.6^). 

3.  ask  other  Students  to  explain  ,(cfl3^) 

-  •  ■       ■        •  ^  ■  ^  . 

4.  discuss  chapter  with  others           ^  '  r+105^) 

5.  read  chapter  summary  (-08^) 
*  6.    underlining                             '  (+07^0 

7.  ask  teacher  to  explain  (.^06^) 

8.  notetaking       *           _  .  ,  (-05%) 

9.  V  reread  chapter  several  times  (-1-04%) 

10.  coiTStruct  an  outline       ,  (-04%) 

11.  read  chapter  through  once  (-03^) 

12.  summarize  the  chapter  (-03%) 

13.  evaluate  extent  of  prior  knowledge  (+02%) 

14.  complete  textbook  questions/activities  (+01%) 

15.  memorize  portions  of  chapter  (+01%) 

16.  self-questioning  ^"?-*^ 

17.  review  subheadings                r- *  '   '  (■••01%) 


TABLE  8C 


Illinois  Students'  Responses  to  P>art  I:    Male  &  Female 


Standa  rd 

Ques  t  i  on 

Mean 

a 

Dev  i  a  t  i  on 

1 

d 

2 

3 

U 

b 

M 

'  F 

M 

F 

M 

F  . 

M 

M 

F 

M 

F 

1 . 

Outline  the   ideas   in  the 
chap  te  r 

1 

.6970 

•1  . 

7U3 

.  /■  1  u  0 

'  /  /Op 

.^2 

(70) 

.^46 

(83) 

.k8 
(79) 

.^0 
(73) 

.07 

(12) 

.  1  1 

(21)  ^ 

.03 

(M 

,•03 
(5) 

2. 

Take  notes   from  what  you  2 
have  read   in   the  chapter 

.0121 

2  . 

1593 

.  oou  / 

.26 
('*3) 

.21 

(38) 

.51 
(8M 

.53 

(97)" 

.  19 

(31) 

.15  ■ 

(2  7) 

.ok 
(7) 

.11 

(20) 

3. 

Underline  important  ideas 
in  the  chapter 

1 

.6970 

1  . 

901  1 

.78^2 

.9110 

(79) 

.k\. 
(7M 

.37 
(61)  . 

.35 
(63) 

.13 

(21) 

.i8 

(3M 

.02 

.06 
(11) 

.  k. 

Summarize   in  your  own  words 
the  chapter  or  parts  of  it 

1 

.9273 

1  . 

8077 

. 859^4 

■. 79^46 

.35 

(57) 

.38 

(69) 

(73) 

.k8 
(88) 

.15 

(25) 

.09 
(16) 

."06 
(10) 

.05 
(9) 

r 

3  • 

Answer  the  questions  given 
in  the  text  or  complete  the 
activities  you  find  included 

2 

9 

.7778 

.768^4 

1  8 
(30) 

1  y 

(32) 

. 

(89) 

.  ^3 

(89) 

22 

(37) 

30  * 
(5M 

.06 

(9) 

.Ok 
(7) 

6. 

Try  to  memorize  important 
parts  of  the  chapter 

2 

.6970  . 

2 . 

.9333' 

.9^*36 

1 

.  10 
(16) 

.09 

(^16) 

56) 

.36- 
(66) 

•  33" . 

>(55) 

.30 

(5M 

.23 

(38) 

.25 
('*6) 

7. 

Pause  to  think  about  what 
you  do  and  do  not  knov/  about 
the  topic  of  the  chapter 
before  you  begin  to  read 

1 

.8061 

1 

9066 

.7801 

.8776 

.39 

.37 
(67) 

\  1^  1 

.kl 

ill) 

.13 

(22) 

Ah 
(26) 

.03 

(5) 

.07 

( K2 ) 

8. 

Ask  yourself  questions  about 
ideas   in  the  chapter." 

2/0061 

n 

2 

0220 

.8077 

.8^472 

.11 
('*5,) 

.28' 
(52) 

.50 

(82) 

(85) 

.18 

(30) 

.19 

(3M 

.05 
(8) 

.06 
(U) 

9. 

Review  all   the  headings 
given   in  the  chapter  before 
you  begin   to  read  the  chapter 

1 

.9091 

1 

90 1  1  . 

.0050 

.975^* 

.kk 
(73) 

.^l 
(78) 

.32 

(52) 

(62) 

.13 

(22) 

.13 

(2M 

.  1  1 

(18) 

.10 
(18) 

ERIC 


9  W  Q 


^  23') 


TABLE  8C  (eontinued) 


Ques  t  i  on 


10.  Read  the  chapter  summary 
before  you  begin  to  read 


1  I  . 
)2. 
13. 

15. 

16. 

17. 


the  chapter 

Pxead  the  chapter  through 
on  1 y  once 

Reread  the  chapter  several 
times 

Read  the  entire  chapter  or 
parts. of  ita loud  to  yourse) f 

Ask  the  teacher  to  explain 

the  entire  chapter  or  parts 

^  .  e 
of   I  t 

As>  other  students  to  help 
explain  the  entire  chapter 
or  par  ts  of  it  ^ 

Discuss  the  entire  chapter 
or  parts  of  it  with  others 

Read  other  books  on  the 
top i c  (s )  di scussed  in  the 
chapter 


Mean 


F 


Standard 
Devi  at  i  on 

M  °l 


2.3939  2.2033 

1.7818  1.8791 

\.ik2k  1.8187 

1.9091  2.0166 


.0689 
.8269 
.6839 
.7055 

\ 


".7108, 


1.7152    1.8297      -705^  .6J82 

2.0121  2.16*48  .7570  .7W2 
1 .3636    1 .1923      .5532  .'1089 


1 

d 

— > — ■ 
2 



3 

M 

F 

M 

F 

M 

F 

M 

F 

(67) 

M 
(89) 

.32 
(52) 

.29 
(52) 

.13 

(22) 

.09 
(17) 

.\k 

(23) 

.13 

(2M 

2  k 
(39) 

.27 
('<9) 

.35  ^ 

(57) 

.  39 
(72) 

.20 
(3M 

.20 
(36) 

.21 

(35) 

.\k 

<25) 

.k2 
(69) 

.38 
(70) 

.kk 
(72) 

M\ 

.09 

( 1 5 ) 

.15 

(20) 

.05 

la  \ 
(3) 

.06 

V  1  'J/ 

.66 

(108) 

M 
(75) 

.26 

(V3) 

.ko 

(73) 

.07 

(12) 

.l**  ' 
(26) 

.01 

(2) 

.Ok 

(8) 

.27 
('^5) 

.21 

(37) 

.57 

(9M 

.61 

(111) 

.13 

(22) 

.\k 
(26) 

.03 

(M 

.Ok 
(7) 

.k\ 

.28 

(79) 

.62 
(112) 

.09 

(15) 

.08 

(15) 

.02 

(3) 

.02 
(3) 

.2h 
(39) 

(25) 

.56 
(92) 

.63 
(115) 

.16 

(27) 

.16 
(29) 

.Ok 
(7) 

.07 
(13) 

.667 
(no) 

.813 
(U8) 

.309 
(51) 

.181 
(33) 

.018 
(3) 

.006 
(I) 

.006 
(1) 

.00 

(0) 

Note.     The  ques'tion  was  "When  you  study  a  chapter  in  your  textbook  how  often  do  you  use  the  following  methods?" 


ERIC 


^  N  =  3'*7 

n  =  16'4.  .'48 
^    n'=  182,  .52 

actual  number  is  in  parenthesis 


232 
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llinois:  .  Part  I  TABLE  8D 

Biology 

Difference  between  Male  and  Female 


1. 

read  chapter  aloud 

(-28%) 

2. 

underlining  ' 

(-11%) 

3. 

suninarize  the  chapter 

(+11%) 

4. 

read  other  sources 

(+10%) 

6. . 

discuss  chapter  with' others 

(-08%) 

7. 

reread  the  chapter  several  times 

(+07%) 

8. 

self-questioning 

(+05%) 

9. 

revievy  subheadings 

(-05%) 

10. 

read  chapter  summary 

(t05%) 

11. 

construct  an  outline 

(+04%) 

12. 

memorize  protions  of  the  chapter  ' 

(-04%) 

13. 

complete  textbook  puestions/acti vities 

(-03%) 

14. 

evaluate  extent  of  prior  knowledge 

(-03%) 

15. 

read  chapter  through  once 

(+03%) 

16. 

ask  other  students-  to  explain 

(-03%) 

17. 

ask  teacher  to  explain 

(+02%) 

Illinoisr  Part  I  TABLE  8E  * 

History 

Difference  between  Male  and  Female 


1.  read  chapter  aloud  (-2U) 

2.  read  other  sources  (+18%) 

3.  ask  other  students  to  explain  (-16%) 

4.  ask  teacher  to  explain  (-12%) 

5.  discuss  chapter  with  others  (-10%) 

6.  reread  the  chapter  several  times  (-08%) 

7.  ^  read  chapter  summary  (+07%) 

8.  underlining  (-06%) 

9.  read  chapter  through  once  (+05%) 

10.  notetaking  (-04%) 

11.  complete  textbook  questions/activities  (+03%) 

12.  construct  an  outline  (+02%) 

13.  sumnarize  the  chapter  (-02%) 

14.  evaluate  extent  of  prior  knowledge  (-02%) 

15.  memorize  portions  of  the  chapter  (+01%) 

16.  self-questioning  (-01%) 

17.  review  subheadings  (-01%) 
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Illinois:    Part  I  TABLE  8F 


Difference  between  History  Males  and  Biology  Males 

1. 

reread  the  chapter  several  times 

(-33%) 

2. 

ask  other  students  to  explain 

(-29%) 

3. 

read  chapter  summary 

(+23%)' 

4. 

ask  teacher  to  explain 

(-18%) 

5. 

underlining 

1+16%) 

6. 

review  subheadings 

(+14%) 

7. 

read  chapter  through  once 

(-09%) 

8. 

complete  textbook  questions/activities 

(-08%) 

9. 

evaluate  extent  of  prior  knowledge 

(+08%) 

10. 

construct  an  outline 

(+07%) 

11. 

read  chapter  aloud 

(-07%) 

12. 

discuss  chapter  with  others 

(-07%) 

13. 

summarize  the  chapter 

(-06%) 

14. 

notetaking 

(-05%) 

15. 

memorize  portions  of  the  chapter 

(+02%) 

16. 

read  other  sources 

(+02%) 

17. 

self-questioning 

(00%) 

o 

ERIC 
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Illinois  Part  I  TABLE  8G 

Difference  between  History  Females  and  Biology  Females 


1. 

read  chapter  summary 

(+21%) 

2. 

reread  the' chapter  several  times 

(-18%) 

3. 

ask  other  students  to  explain 

(-16%) 

4. 

complete  textbook  questions/activities 

(-14%) 

5. 

read  chapter  aloud 

(-14%) 

6. 

underlining 

(+11%) 

7. 

read  chapter  through  once 

(-11%) 

8. 

review  subheadings 

(+10%) 

9. 

construct  an  outline 

(+09%y 

10. 

notetaking 

(-09%) 

IT. 

summarize  t^e  chapter 

(+07%) 

12. 

evaluate  exi^pt  of  prior  knowledge 

(+07%) 

13. 

self-questioning  " 

(+06%) 

.14. 

read  other  sources . 

(-06%) 

15. 

discuss  the  chapter  with  others 

(-05%) 

16. 

ask  teacher  to  explain 

(-04%) 

17. 

memorize  portions  of  the  chapter 

(-03%) 

i 


ERIC 


Texas            '                   Table  9A  - 
Collapsed  Frequency  of  Students'  Responses  to  Survey:    Part'  II 

1.  Important  Ideas  not  clearly  pointed  out  {63%) 

2.  not  enough  examples  or  clarification  of  key  ideas  (63%) 

3.  good  summary  of  chapter  not  Included  (62%) 

4.  students  expected  to  know  more  than  they  do  (60%) 

5.  text  out-of-date                                                "  (57%) 

6.  ideas  not  related  to  what  students  may  already  know  (56%) 

7.  topic  not  covered  in  as  much  detail  as  needed  (56%) 

8.  '  Important  relationship   between  ideas  not  pointed  out  (55%) 

9.  vocabulary  difficult  to  understand  (53%) 

10.  more  detail  included  than  necessary                       ^  (53%) 

11.  insufficient  introductory  or  background  information  (52%) 

12.  text  written  in  a  way  which  is  difficult  to  follow  (41%) 

13.  irrelevant  information  Included  (34%) 
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TABLE  9B 


\ 


1 

2\ 

3 

u 

5 

Ques  1 1  on 

M 

Hean 

Standard  — 
Devi  a li  on 

Ne  ve  r 

Almost 
Mever 

Somet  Imes 

Almost 
Always 

Always 

1.  The  text  uses  vocabulary  which 
is  difficult  to  understand, 

275 

.2  .^36 

.971 5 

.  1  7 

.  JU 

(81) 

(107) 

•  1 3 

(36) 

n  1 
■  (M 

2.  The  text  does  not  clearly 
point  out  the  main  Ideas. 

273 

2.7602 

.9331 

.08 
(23) 

.29 

(78) 

.'*2 
U  lb; 

.18 

.03 

(8) 

3,  The  text  expects  you  to  know 
more  about  what  you  are 
reading  than  you  do. 

276 

2.7609 

1 .0825 

.  I<< 

(39) 

.26 
(71) 

.35 
(97) 

r20 
(55) 

.05 
(Ht) 

'i.  The  text  does  not  provide 
enough  examples  or  clarifi- 
cation of  key  ideas. 

276 

2.775** 

1.0056 

M2 

(33) 

.25 
(70) 

» MO 

(109) 

I  .39^ 
(I07)j 

.21 
(58) 

(B). 

5,  The  text  Is  poorly  organlzed-- 
that  ts,  the  text   )s  written 
in  a  way  which  is  difficult 
to  fol low. 

275 

2.^1000 

1  .0288 

.  19 
(52) 

(78) 

r 

no 
(2M 

0<i 

(12) 

6,  The  text ^does  not  provide 
sufficient  intrpductory  or 
background  Informat  ^on  before 

nr'<*%^nt  Inn   nc*M    1  dftA4  . 

275 

2.556ii 

1  .0070 

.15 

.33 

(91) 

(93) 

.15 

(^1) 

,03 
(7) 

7,  The  text  docs  not  a l tempt  to 
relate  Ideas  to  what  you 
already  know  about  the  topic. 

271 

2 .b/ 1 b 

.  1  ? 

29 
(79) 

3S 

(95) 

.16 
(^M 

.05 
(13) 

8,  The  text  Is  oui-of-date-- 
ihat  Is,  the  text  docs  not 
discuss  current  Issues. 

2.7^82 

^  ^  1 .1977 

.18 

.25. 
(68) 

I. 

.30 

.18 
{US) 

.09 

f. 

ERIC 


2^3 


TABLE  9B, (continued) 


Ques  1 1  on  ' 


9.  The  text  presents  Irrelevant 
information  which  Is  not 
related  to  the  purpofse  for 
which  the  text  J's  Intended. 

^  10.  The  text  does  not  point  out 
^   '     Important  relationships 

between  key  Ideas.  ^ 

If.  The  text  does  not  Include 

a  good  summary  of  the  chapter. 

12.  The  text  does  not  cover  as 
much  of  the  topic  as  the 
teacher  ejE^ects  you  to  know. 

13,  The  text  goes  into  more 
detail  than  is  appropriate 
for  your  purpose>s. 


Standard 
^"Devlat  ion 

1 
1 

2 

1 

if 

5 

•  Mean 

Never 

Almost 
Never 

Somet  Ims 

Almost 
Always 

Always  . 

275 

2.1927 

•  9335 

.2i* 
(66)  . 

(116) 

.27 
(73) 

.05 
(IM 

,02 
(6) 

275 

"  2.6218 

.12 

.33 
(90) 

.38 

(105) 

(38) 

.03 

272 

2.9375  - 

1 .2566 

.16 
{'•'•) 

.22 
(58) 

.27* 

'  (7M 

.23 
(63) 

1  O 

(33) 

276 

2.7101 

IJ952 

.19 

(52) 

.25 
(69) 

.31 
(85) 

■  .17 
■*   {'•7)  • 

.08 
(23) 

2  76 

2,5978 

1,0793 

.17 
{'•6) 

.30 
(82) 

.37 
(103) 

.10 
(27) 

.06 
(l8) 

Illinois  TABLE  lOA 

1.  important  ideas  not  clearly  pointed  out  |(80%) 

2.  vocabulary  difficult  to  understand  (79%) 

3.  students  expected  to  know  more  than  they  do  /  (78%) 
4..  ideas  rjpt  related  to  what  students  may  alreaay  knoW  (77%) 

5.  not  enough  examples         '  (75%) 

6.  topic  not  covered  in  as  much  detail      needed  ^      .  (75%) 

7.  irrelevant  information  included  (75%) 

8.  relationships  between  important  ideas  not  pointe|l  out  (68%) 

9.  good  chapter  summary  not  included                        .  (68%) 

10.  insufficient  introductory  or  background  information  (67%) 

11.  ideas  organized  in  a  way  which  is  difficult  to  follow  (66%) 

12.  text  out-of-date          /  .  (51%) 


/ 


V 


302 


TABLE  lOB 


Question 


Mean 


Standard 
Devi  at  ion 


never  a 
prob lem 


somet  imes 
a  problem 


a Imos  t 
a  il^ays  a 
problem" 


always 
a  Droblem 


1.  The  text  uses  words  which  are  '         \ .3^2^ 
difficult  to  unders.tand 

2.  The  text  does  not  tell  you  2.233'* 
which  ideas  in  the  chapter 

are  important;  that  is, 
which  ideas  you  should 
remembe  r  " 

3.  The  text-does  not  tell  you  2. 1^470 
how  one  important   idea  is 

related  to  another  important 
idea 

k.  The  text  does  not  explain  how  2.l6'»7 
new  ideas  are  related  to 
>  things  you  already  know 

5.  |  The  text  organizes   ideas   in  1.8790 
Sa  way  which  is  difficult  to  " 

fol low  ^ 

6.  The  text  does  not  include  1.8613 
enough  background  information 

before  it  discusses  new  ideas 


MS 
.8997 


,8560 


.8807 


.8063. 


7715 


.21 

(73) 

.20 
(71) 


.22 
(77) 


.23 

(79) 


.(119) 


,  .33' 
V  (116) 


.66 

(230) 

(162) 


.^3 

(170) 


.^7 
(162) 


.^9 
(168) 


.51 

(176) 


.10 

(35) 

.22 
(76) 


.21 

(72), 


.21 

(7M 


.12 
('*3) 


.12 
(^0) 


.03 

(9) 


(38) 


.08 

(28) 


.09 
(31) 


.05 
(17) 


.Ok 
(11») 


ERIC 


3oJ 


3U4 


TABLE  lOB  (continued) 


3 


Quest  ion 


Mean 


Standard 
Deviat  ion 


never  a 
problem 


somet  imes 
a  problem 


almost 
always  a 
problem 


■  ■  V 

always 
a  problem 


t 

(1)6) 


.11 

(38) 


.1A 

(50) 


.13 


7.  The   text  does  not  include 
,  enough  examples  to  help 

you  understand  new  ideas 

8.  The  text  does  not  include 
a  good  summary  of  the 
important  ideas  in  the 
chapter 

9.  The  text  expects"  you  to 
know  more  about  what  you 
are  reading  than  you 
usua  1  1  y  do 

10.  The  text  does  not  discuss 
as  many  of  the  ideas  as 
the  teacher  expects  you 
to  knov/ 


2.0U5 


2.0720 


2.2939 


2.1816 


7782 


.9635 


M7 


.9'»89 


.25 
(86) 


.32 
(111) 


.22 
(75) 


.25 
(86) 


.53 

(185) 


.^♦0 
(138) 


.'»2 
(l'»5) 


.'♦5 
(156) 


,17 
(59) 


.17 

(60) 


.22 

(77) 


.17 

(61) 


1  I .  The   text  spends  too  much 
time  discussing  ideas  the 
teacher  does  not  expect 
you  to  know 

1?     The  text   is  out-of-date-- 
that   is,  the  text  does  not 
discuss  current  issues. 


2.0576 


,8'»'»6 


.  1  .7205 


,8929 


.25 

(87) 


.^9 
(171) 


.52 
(180) 


.38 
(131) 


.15 

(53) 


.05 
(16) 


.08 
(27) 


.08 
(29) 


ERIC 


3Uu 


3LIG 


Texas 


TABLE  11 


BIOLOGY 


1.  students  expected  to  know  more  than  they  do  (65%) 

2.  good  chapter  summary  not  Included  (64%) 

3.  Important  Ideas  not  clearly  pointed  Qut  (63%) 

4.  not  enough  examples  or  clarification  of. key 
ideas  (62%) 

5.  vocabulary  difficult  to  understand  (59%) 

6.  ideas  not  related  to  what  students  may 

already  know  (57%) 

7.  relationships  between  important  ideas 

not  pointed  out  (57%) 

8.  more  detail  included  than  necessary  (57%) 

9.  topics  not  covered  in  as  much  detail  as 

needed  (56%) 

10.  insufficient  introductory  or  background 

^   information  (55%) 

11.  text  out-of-date  (55%) 

12.  text  written  In  a  way  which  is  difficult  /ac<^\ 
to  follow 

13.  Irrelevant  information  included  (35%) 


ERLC 


3'Ji' 


 HISTORY  

1.  not  enough  examples  or  clarification  of 

key  ideas                                       '  (64%) 

2.  text  out-of-date  (64%) 

3.  Important  Ideas  not  clearly  pointed  out  (62%) 

4.  good  chapter  summary  not  included  (58%) 

5.  topics  not  covered  in  as  much  detail  as 
needed  (56%) 

6.  Ideas  not  related  to  what  students  may 
already  know  (55%) 

7.  relationships  between  important  ideas 

not  pointed  out  (50%) 

8.  students  expected  to  know  more  than 

they  do  (48%) 

9.  Itore  detail  included  than  necessary  (42%) 

lb.    Insufficient  Introductory  or  background 

Information  (41%) 

11.  vocabulary  difficult  to  understand  (36%) 

12.  irrelevant  information  included  (30%) 

13.  text  written  In  a  way  which  Is 

difficult  to  follow  (29%) 


3Ud 


Texas  TABLE  TIB 

Difference  between  Biology  and  History 

1.  vocabulary  difficult  to  understand  {-23%) 

2.  students  expected  to  know  more  than,  they»do  ( -1 7?S) 

3.  text  written  in  a  way  which  is  difficult  {-16%) 

to  follow 

4.  more  detail  included  than  necessary  (-15?^) 

5.  insufficient  introductory  or  background 

information 

6.  text  out-of-date  (+09%) 

7.  relationships  between  important  ideas  not  {-07%} 

pointed  out 

8.  good  chapter  summary  not  included  {-06%) 

9.  irrelevant  information  included  {-0S%) 

10.  not  enough    examples  or  clarification  of  [+02%) 

key  ideas 

11.  ideas  not  related  to  what  students  may     ^  (-02%) 

al ready  know 

12.  important  ideas  not  clearly  pointed  out  (-0U) 

13.  topics  not  covered  in  ^^is  much  detail  as  {00%) 

needed 


i 


TABLE  nc 


Mean 


Ques  1 1  on 


Standard 

Oevlat  ion 


Never 


Almost 
Never 


Somet  Imes 


Almost 
Always 


B  H 


I.  The  text  utes  vocabulary  which  20<*  7) 
Is  difficult  to  understand. 


2.  The  text  does  not  c Yearly  203 
point  out  the  main  Ideas. 


3. 


The  text  expects  you  to  know  205 
more  abouf^what  you  are 
reading  than  you  do. 

The  text  does  not  provide  205 
enough  examples  or  c I ar I  fl** 
cation  of  key  Ideas. 

The  text  is  poorly  organl zed--20J4 
that  is,  the  text  Is  written 
in  a  way  which  is  difficult 
to  follow. 


The  text  does  not  provide 
sufficient  introductory  or 
background  Information  before 
presenting  new  ideas. 


The  text"*  does  not  attempt  to  202 
relate  ideas  to  what  you 
already  know  about  the  topic. 


70 
71 


2.6<i7l  2.1690 
2.8276"  2. 6^129* 
2.8390  2,5352 


.9379 


.SUdS  .8852 
1.0839  1.0533 


71    2.7'»15    2.8732    1.0080  .9990 


71    2.^^02    2.\U0B    1  .0^*81  .930*1 


Always 


205      70    2.6098  2.J<000 


B 

H 

B 

H 

B 

H 

D 

H 

B* 

H 

.13 

.30 

.28 

.3't 

.'•2 

.28 

.15 

.07 

.02 

.01 

(26) 

(21) 

* 

(57) 

(21.) 

(87) 

(20) 

(31) 

(5) 

(3) 

(1) 

.08 

.11 

.29 

.27 

.1*0 

.'.9 

.20 

.12 

.03 

.01 

(8) 

(19) 

(82) 

Mil) 

(8) 

(7) 

(1 ) 

.13 

.17 

.22 

.35 

.38 

.28 

.21 

.17 

.06 

.03 

(27) 

(12) 

(25) 

(77) 

(20) 

(12) 

(12) 

(2) 

.07 

.2'« 

.29 

.39 

.38 

.21 

.20 

.02 

.06 

(28) 

(5) 

{1*9) 

(21) 

(80) 

(27) 

(IM 

(M 

(.M 

.17 

.26 

.38 

.'<5 

.31 

.21 

.09 

.07 

.05 

.01 

(3M 

(18) 

(77) 

(32) 

(63) 

(15) 

(19) 

(5) 

(il) 

(1) 

> 

.15 

.17 

.30 

.1*2 

.35 

.30 

.18 

.07 

.02 

(31) 

(12) 

(62) 

(29) 

(72) 

(21) 

(36) 

(5). 

(M 

(3) 

69  2.6931  2.6087 


l.09'<9      .973'<      .15      .13       .28  .32 
(31)     (9)        (57)  (22) 


8,  The  text  Is  out-of-date — 
thdt  Is,  the  text  does  not 
discuss  current  Issues. 


205     .69    2.6732^2.9710     l.|l*00     1.3391       .17  .20 


.28 


.16 


(35)    (IV)^    (57)  (11) 


.3'<  .39  .17  .13  .06  .03 
(68)     (27)      ^5)     (9)        CM)  (2) 


,33  .23  .15  .28  .07  .13 
(68)     (16)      (30)    (19)      (15)  (9) 


ERIC 


310 


311 


TA8LE  lie  (continued) 


I 


Mean 


Quest lont 


Standard 

Devi atl on 


Never 


Almos  t 
Never 


Socnet  Ime9 


Almost 
Always 


r 


9.  The  text  presents  Irrelevant 
Information  which  Is  not 
related  to  the  purpose  for 
which  the  text  Is  Intended. 

10.  The  text  does  not  point  out 
Inportant  relationships 
between  key  Ideas. 


11.  text  does  not  Include         203  69 
a  90od  sunmary  of  the  chapter. 

12.  The  text  does  not  cover  as       205  71 
much  of  the  topic  as  the 

teacher  expects  you  to  know. 

13.  The  text  goes  Into  more  205  71 
detail  than  Is  appropriate 

for  your  purposes. 


205      70    2.2195  2.ll'»3 


20k      71    2.6ii71  2.5'»93 


"1 


Always 


D 

H 

B 

H 

D 

n 

a 
D 

n 

D 

n 

D 

n 

.9679 

.8261 

.2^ 

.23 

.'•7 

.26 

m 

.06 

.015 

.03 

.015 

^  (50) 

(16) 

(83) 

(33) 

(SM 

(^9) 

(13) 

(1) 

(5)  ' 

(1) 

.9689 

.9679 

.12 

.13 

31 

.37 

.38 

.38 

.  16 

.08 

.03 

.Oil 

(25) 

(9) 

(6i*) 

(26) 

(78) 

(27) 

(32) 

(6) 

(5) 

(3) 

1 .2580  " 

1.2592 

.  16 

.  16 

.20 

.26 

.28 

.25 

^22 

.12 

<  1 1 

(33) 

(II) 

('♦o) 

(18) 

(57) 

(17) 

('.8) 

(15) 

(25) 

(8) 

1.1 807, 

\,2k\ 1 

.19 

.17 

.25 

.27 

32 

.28 

.17 

.17 

.07 

.  1 1 

J 

m 

(12) 

(50) 

(19) 

(65) 

(20) 

(35) 

(12) 

(15) 

(3) 

1.1150 

.9223 

.16 

.20 

.27 

.38 

38 

.3't 

.ir 

.07 

.08 

.01 

(32) 

(H") 

(55) 

(27) 

(79) 

(2'i) 

(22) 

(5) 

(17) 

(1) 

-J— 

-4^ 

ERIC 


3 1  ( 


Illinois 


TABLE  1 


BIOLOGY 


1. 

vocabulary  difficult  to  understand  - 

(90%) 

2. 

student  expected  to  know  more  than 
tney  ao 

V  OOto  } 

3. 

more  information  included  than 
necessary 

\0  \  h  } 

re  1 atl onsni ps  Detween  important  laeas, 
not  pointed  out 

(76%) 

5. 

ideas  not  related  to  what  students  may 
already  know 

(76%) 

6. 

important  ideas  not  clearly  pointed  out 

(75%) 

7. 

topics  not  covered  in  as  much  detail  as 
heeded 

(^4%) 

8. 

not  enough  examples 

(74%) 

9. 

insufficient  background  information 

(71%) 

10. 

good  chapter  summary  not  included 

(70%) 

ij. 

ideas  organized  in  a  way  which  is 
difficult  to  follow 

(68%) 

12. 

text  is  out-of-date 

(54%) 

ERIC 


314 


HISTORY 


1.  important^ ideas  not  clearly  pointed  out  (83%) 

2.  relationships  between  important  ideas 

not  pointed  out  (79%) 

3.  ideas  not  related  to  what  students  may  ^ 
already  know                  \  (78%) 

4.  not  enough  examples  (76%) 

5.  topics  not  covered  in  as  much  detail  as 

needed  (76%) 

6.  student  expected  to  know  more  than  they  do  (75%) 

7.  vocabulary  difficult  to  understand  (71%) 

8.  more  information  included  than  necessary  (71%) 

9.  good  chapter  summary! not  included  (67%) 

10.  ideas  organized  in  a  way  which  is 

difficult  to  follow               ^  (64%) 

11.  insufficient  background  information  (63%) 


12, 


text  out-of-date  ^     .  (48%) 


31J 


Illinois  '  TABLE  12B 

Difference  between  Biology  and  History 

1.  vocabulary  difficult  to  understand  (-19%) 

2.  more  information  included  than  necessary  (-10%) 

3.  student  expected  to  know  more  than  they  do  (-08%)/ 
4^   important  ideas  not  clearly  pointed  out  (+08%) 

5.  insufficient  background  information  (-08%) 

6.  text  out-of-date        /  (-06%) 

7.  ideas  organized  in  a  way  which  is  difficult  (-04%) 

to  follow 

8.  good  chapter  summary  not  included  ^.  (-03%) 

9.  relationships*  betwirfen  important  ideas  not  (+03%) 

pointed  out 

10.  ideas  not  related  to  what  students  already  (+02%) 

know 

11.  not  enough  examples  t+02%) 

12.  topics  not  covered  in  as  much  detail  as  (+02%) 

needed 


TABLE  12C 


3 


Ques  1 1  on 


Mean 


Standard 
Oeviat  ion 


B 


never  a 
problem 


somet  imes 
a  problem 


almost 
always  a 
prob I  em 


always 
a  problenj 


H 

B 

H 

B 

H 

B 

H 

B 

H 

.7016 

.10 

.29 

,.78 

V.58 

.10 

.10 

.02 

.03 

(15) 

(58) 

(111) 

(1 19) 

(H) 

(21  ) 

(3)  . 

>(6) 

9095 

.2^4 

.  18 

.21 

.22 

.08 

•  1 3 

(3M 

(37) 

(65) 

.  (97) 

(32) 

'm) 

(12) 

(261 

.8810 

2^4* 

.  2  1 

.48 

.  50 

21 

19 

05 

.  10 

(35) 

U2) 

(68) 

(102) 

(33) 

(39) 

(7) 

(21) 

.9162; 

.m 

.22 

.51 

.19 

.23 

.06 

.n 

(3M 

(^♦5) 

(73) 

(89) 

(27) 

(^♦7) 

(9) 

(22) 

.8665  ' 

.32 

.36 

1 

.55 

.10 

.14 

.03 

.06 

(^♦6) 

(73> 

■  (79) 

|j89) 

(U) 

(29) 

(M 

(13) 

.29 

.37 

.53 

.50 

.15 

.09 

.03 

.04 

(M) 

(75) 

(75) 

(101) 

(22) 

(18) 

(5) 

(9) 

The  text  uses  words  which  are  -2.0350  1.8775 
difficult  to  understand 


2.  The  text  does  not  tell  you 
which  ideas   in  the  chapter 

^.    J  are  important;  that  is, 
which  ideas  you  should 
remember 

3.  The  text  does  not  tell  you 
how  one  important  idea  is 
related  to  another  important 
idea 

4.  The  text  does  not  explain  how 
new  ideas  are  related  to 
things  you  already  know 

5.  The  text  orgfanizes  ideas  in 
a  way  which  is  difficult  to 
fol 1 ow  • 

6.  The  text  does  not  include 
enough  background  information 
before  it  discusses  new  Ideas 


2.1538  2.2892 


.9371 


.8079 


5362 
,8826 


2.0839    2.1912  .8179 


2.0769    2.2266  .8229 


I .8322    1.9118  .7119 


.7619 

7 


ERIC 
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'  313 


TABLE  12C  (continued) 


Ques  t  ion 


Mean 


Standard 
Devi  at  i  on 


never  a 
prob 1  em 


somet  imes 
a  problem 


almost 
always  a 
prob 1  em 


always 
a  problem 


B 


H 


B 


H 


B 


H 


B 


H 


B 


H 


7.  The  text  does  not  include 
enough  examples  to  help 
you  understand  new  ideas 

8.  Th^  text  does  not  include 
a  good  summary  of  the 
important   ideas   in  the 
chapter 

9-  The  text  expects  you  to 
k^now  more  about  what  you 
are  reading  than  you 
usua  I  I y  do 

10.  The  text  dohs  not  discuss 
as  many  of  the   ideas  as 
the  teacher  expects  you 
tg  know 

I  1 .  The  text  spends  too  much 
time  discussing   ideas  the 
teacher  does  not  expect  ^ 
you  to  know 

1' 

12.  The  text   is  out-of-date-- 
that   is,   the  text  does  not 
discuss  current  issues 


1.9580    2.05'«2      .7108  .8217 


.26 

(37) 


.5^  .53 
(77)  (108) 


.19 
(27) 


.16 

(32) 


.01 
(2) 


.07 
(U) 


2.0'*90  2.0882 


,906'*    1.0035     .30      .33      .'♦3      .37      .18      .17      .09  .13 
('♦3)     (68)     (62)     (76)     (26)     (3M     (12)  (26) 


2.3706    2.2'*02      .9320      .9857     .17      .25      .^2      .M       .27      .19      .I'*  .15 

(25)     (50)     (60)     (85)     (38)     (39)     (20)  (30) 


2.1189  2.2255 


2.10'»9  2.02'»5 


.9306      .961'*     .26      .2^4      .i»8      .'»3      .I'*      .20      .12  .13 
(37)     ('♦9)     (69)     (87)     (20)-    (M )     (17)  (27) 


7572      .9012     .19      .29      .57      .^S       .19      .12      .05  .10 
(27)     (60)     (81)     (99)     (28)     (25)     (7)  (20) 


1.608'*     1.7990      .6611     1.0189     .'♦6      .52      .50      .29      .01      .07      .03  .12 

(66)   (105)     (71)     (60)     (2)      (IM     (i.)  (25) 
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Table  13A 

 MALE  

1.    not  enough  examples  or  clarification  of  ideas  (62%) 

'  2.    important  ideas  not  clearly  pointed  out  (60%) 

3.  good  chapter  summary  not  included  (60%) 

4.  more  detail  included  than  necessary  (59%) 

5.  topic *s  not  covered  in  as  much  detail  as 

needed  (57^) 

6.  text  is  out-of-date  (52%) 

7.  ideas  not  related  to  what  students  may 

already  know  (51%) 

8.  .relationships  between  important  ideas  not    ^  ^ 
pointed  out  .  (51%) 

9.  students  expected  to  know  more  than  they  do  (50%) 

10.  vocabulary  difficult  to  understand  (46%) 

11.  insufficient  introductory  or  background 
information.  ^  (45%) 

12.  written  in  a  way  which  is  difficult  to 

follow  (42%) 

13.  irrelevant  information  included  (36%) 


ERiC 


  FEMALE  

1.  students  expected  to  know  more  than  they  (68%) 
do. 

2.  good  chapter  summary  not  included  (65%) 

3.  important  ideas  not  clearly  pointed  out  (65%) 

4.  not  enough  examples  or  clarification  of 
ideas                            ;  (63%) 

5.  text  out-of-date                        .  (62%) 

6.  vocabulary  difficult  to  understand  (60%) 

7.  ideas  not  related  to  what  students  may 
already  know             ^  (60%) 

8.  relationshijDS  .between  important  ideas 

not  pointed  out  (58%) 

9.  insufficient  intr9ductory  or  background 
information  (57%) 

10.  this  not  covered  in  as  much  detail  as 

needed  (56%) 

11.  more  detail  included  than  necessary  (49%) 

12.  text  written  in  a  way  which  is  difficult 

to  follow              '  (40%) 

13.  irrelevant  information  included  (32%) 


Texas 


^  Table  13B 

Difference  between  male  &  female 


1.  students  expected  to  know  more  than  they  do  (-18%) 

2.  vocabulary  difficult  to  understand  (-14%) 

3.  insufficient  introductory  or  background  information  (-12%) 

4.  text  out-of-date  t-10%) 

5.  more  detail  included  than  necessary  (+10%) 

6.  ideas  not  related  to  what  students  may  already  know  (-09%) 

7.  relationships  between  important  ideas  not  pointed  out  (-07%) 

8.  important  ideas  not  clearly  pointed  out  (-05%) 

9.  good  chapter  summary  not  included  (-05%) 

10.  irrelevant  information  included  (+04%) 

11.  text  written  in  a  way  which Js  difficult  to  follow  (+02%) 
12..  not  enough  examples  or  clarification  of  ideas  (-01%) 
13.  topics  not  covered  ih  as  much  detail  as  needed  (+01%) 


/ 


ERiC 


TABLE  13C 


Question 


Hean 


$lan_ 
Deviation 


Hever 


Almost 
Ne  ve  r 


Soniet  Imes 


Almost 
Always 


Always 


I.  The  text  uses  vocabulary  which  1 23    U6    2.36<*3  2.66'*'* 
Is  difficult  to  understand. 


2.  The  text  does  not  clearly 
f>olnt  out  the  main  Ideas.  , 


127    l'*6    2.6830  2.8630 


.9677  .9561 
.8329  I.007B 


3.  The  text  expects  you  to  know    130    \k(>    2.5'»62    2.9521    1.0351     1  0912 
more  about  what  you  are 
reading  than  you  do. 


k.  The  text  does  not  provide 
enough  examples  or  clarifi- 
cation of  key  ideas. 


130    1^*6    2.7I5'»    2.8288     .9979  1.0127 


5/The  text  is  poorly  organ ized— 1 29    l'»6    2.^*031     2.3973    I  .0I9S    I  .0'*0'* 
that  is.  the  text   is  written 
in  a  way  wh i ch  i s  d i f f I cu I t 
10  fol iow. 

6.  The  text  does  not  provide  130     1^*5    2.'*6l5    2.6'*)'*     1.0'*29  .9695 
sufficient   introductory  or 

background  information  before 
presenting  new  ideas. 

» 

7.  The  text  does  not  attempt  to    128    l'*3    2,609'*  2.7273 
relate  ideas  to  what  you 
already  know  about  the  topic. 


0812  ),o'*9'* 


8.  The  text   is  out-of-date-- 
that   IS,   the  text  does  not 
discuss  current  issues. 


129    l'*5    2.6667    2.8207    1.1880  1.2057 


.21 
(28) 

.13 
(19) 

.33 
('.2) 

.27 
(39) 

.3V 
CM 

.'•3 
(63) 

.11 

(C) 

.15 
(22) 

.01 
(1) 

.0^ 
(3) 

.07 
(9) 

.10, 
(l'») 

.33 
('.2) 

.25 
(36) 

M 
(57) 

.kQ 
(59) 

.C 

(la) 

.21 
(30) 

.01 

(1) 

.Oil 
(7) 

.17 
(22) 

.12 

(17) 

.33 

Ci^) 

.20 
(28) 

.31 
Cio) 

.39 
(57) 

.»7 
(22) 

.22 
(33) 

.02 
(3) 

.07 
(II) 

.1'* 
(18) 

.10 
(15) 

.2'. 
(31) 

.27 
(39) 

.^2 
(5'*) 

36 
(53) 

..18 
(2'*) 

.23 
(3'») 

.02 
(3) 

.01* 
(5) 

.19 
(2'*) 

.  19 

(28) 

.39 
(50) 

M 
(59) 

.31 
Co) 

.26 
(38) 

.07 

A3) 

.10 

(15) 

.01*  .Ok 
(6)  (6) 

.18 
(2'*) 

.13 
(19) 

.37 
('.8) 

.30 
('.3) 

.28 
(36) 

(57) 

(18) 

.16 
(23) 

.03/- 
C*) 

.02 
(3) 

.16 
(20) 

(20) 

.33 
('.2) 

.26 
(37) 

.32 
CD 

.38 
(5'.) 

Ah 
(18) 

.18 
(26) 

.05 
(7) 

.01* 
(6) 

,18 
(23) 

.18 

(26) 

.30 
(39) 

.20 
(29) 

.28 
(36) 

.33 
C8) 

(20) 

.20 
(29) 

.08 
(II) 

.09 
(13) 

TABLE  13C  (continued) 


Mean 


Standard 
Devi  at  ion 


Almost 


Quest  ions 


Always 


hornet  ifnes 


Almost 
Always 


M  F 


9.  The  text  presents  Irrelevant 
Information  which  Ms  not 
related  to  the  purpose  for 
which  tfVe  text  Is  Intended. 

10.  The  text  does  not  point  out 
important  relationships 
between  key  ideas. 


)l.  The  text  doe>- not  include  129 
a  good  suiYfary  of  the  chapter. 

12.  Ttte  text  docs  not  cover  as  130 
^nuch  of  the  topic  as  the 
teacher  expects  you  to  know. 


1)0    l^^S    2.2)08  2.1586      .9**i*5  .9255 

1)0    1^*5    2.5615  2.6759      .8892  1  .O))'* 

I'*)    2.7907  ).0699  1.2096  r.287) 

v2.75)8  2.671^  ).2076  1.1868 


1).  The  tiNt  goes   Irrto  more 

detail  than  Is  appropriate 
for  your  purposes. 


1)0     1^*6    2.72)1     2.i*86)     1.0538  1.0520 


.2)  .25 

()0)  06) 


.'♦I  .'♦) 
(5))  (61) 


.29  .25  .05  .05  ,  ,02  .02 
07)    06)      ilY   M)       (3)  (3) 


.10 
(13) 

.15 
(21) 

.39 
(51) 

".27 
(391 

.37 
('•8) 

.39 

(57) 

.12 
(16) 

.15 
(22) 

.02 
(2) 

.oil 
(6) 

.18 
(23) 

.  15 
■  (21) 

.22 
(29) 

.20 
(29) 

.32 
CD 

.23 
(33) 

.19 
(21.) 

.27 
(39) 

.09 
(12) 

.15 
(21) 

.18 
(23) 

.20 
(29) 

.25 
(33) 

.2U 
(36) 

■  -30 
(39) 

.32 

.18 

(23) 

.16 
(21*) 

.09 
(12)^ 

.08 
(11) 

.15 

(19) 

,18 
(27) 

.26 
(3'*) 

.33 
(1.8) 

.36 

(52) 

.  12 
(16) 

.08 

(II) 

.08 
(10) 

,05 
(8) 
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■Table  1 3D  c 

Texas  BIOLOGY 

Difference  betwe^  male  &  female 


1 

1 . 

stuqients  expected  to  know  more  tnan  tney  ao 

\  -fcO/o  / 

2. 

vocabulary  difficult  to  understand 

\  -  1  O/o  ) 

3. 

insufficient  i ntroducti on  or  oacKQrouna  i nrornia ti on 

/-I 

^  —  1  OA)  / 

Ideas  not  related  to  wnat  students ^niay  aireauy  isnow 

^  —  WJfOf 

5. 

text  out-of-date  ^ 

6. 

more  detail  included  than  necessary 

"(+08%) 

7.. 

text  written  in  a  way  which  is  difficult  to  follow 

(+05%) 

8. 

relationships  between  important  ideas  not  pointed  out 

(-05%) 

9. 

irrelevant  information  included. 

^+U4%j 

10. 

not  enough  examples  or  clarification  of  "ideas 

(-03%) 

11. 

good  chapter  surmnary  not  included  ^ 

(-03%) 

12. 

topics  not  covered  in  as  much  detail  as  iieedefl 

(+01|) 

13. 

important  ideas  not  pointed  out 

I 

X 

(-01%) 

V 


I. 


■■  *.  •  ■ 


ERIC 


.  '  Table  13E 

■    .  ■    •  ■  ■  ■  -  ■     .    ^  ■   ■  ■    .  r 

Texas  (Part  II)  HISTORY 

Difference  between  male  S^female 


1. 

insufficient  introductory .or  background  informati on 

(-17%) 

2. 

relationships  between  important  ideas  not  pointed  out 

(-15%) 

3. 

vocabulary  difficult  to  understand 

(-13%) 

4,. 

text  is  out-of-date 

(-12%) 

5. 

good  chapter  summary  not  included 

(-11%) 

6. 

not  enough  examples  or  clar-^cation  of  ideas 

(+08%) 

7. 

text  written  in  a  way  which. is  difficult  to  follow 

(-08%) 

8. 

relationships  between  important  ideas  not  pointed  put 

(-06%)- 

9.. 

'irrelevant  information  included 

(+04%)  1 

10. 

important  ideas  not  clearly  pointed  out 

(+03%)  . 

Tl. 

.  topics  not  covered  in  as  much  detail  as  needed 

(+03%) 

12. 

more  detail  included  than  necessary 

(+02%) 

13. 

students  expected  to  know  more  than  they  do 

(+01%) 

■4 

J 


'J2D 


Texas  '      Table  13F 

Difference  between  History  males  &  Biology  males  • 


1. 

more  detail  included  than  necessary 

(  -46%)  , 

2. 

text  is  written  in  a  way  which  is  difficult  to  follow 

(-24%) 

3. 

vocabulary  difficult  to  understand 

(-22%) 

4. 

insufficient  introductory  or  background  information 

(-16%) 

5. 

relationships  between  important  ideas  not  pointed  out 

(/12%) 

6. 

good  chapter  summary  not  included 

(-11%) 

7. 

not  "enough  examples  or  clarification\if  ideas 

(+07%) 

8. 

text  is  out-of-date  y/""""^"^ 

(+07%) 

9. 

irrelevant  information  included 

(-05%) 

10. 

important  ideas  not  clearly  pointed  out 

(+04%) 

n. 

students  expected  to  know  more  than  they  do 

(-02%)  , 

12. 

ideas  not  related  to  what  students  may  already  know  - 

(+01%) 

13. 

topics  not  covered  in  as  much  detail  as  needed 

(+01%)  . 

Texas    '  '        Table  13G 

Difference  between  History  females  &  Biology  females 

1.  more  detail  included  than  necessary  (-40%) 

2.  students  expected  to  know  more  than  they  do  (-31%) 

3.  vocabulary  difficult  to  understand  (-25%) 

4.  insufficient  introductory  and  background  information  (-12%) 

5.  text  is  written  in  a  way  which  is  difficult  to  follow  (-11%) 

6.  text  is  out-of-date  .  (+10%) 

7.  important  ideas  not  clearly  pointed  out  (-09%) 

8.  irrelevant  information  included  .  (-05%) 

9.  not  enough  examples  or  clarification  of  ideas  (-04%) 

10.  ideas  not  related  to  what    students  may  already  know  (-03%) 

11.  good  chapter  summary  not  included  (-03%), 

12.  relationships  between  important  ideas  not  pointed  out  (-02%) 

13.  topics  not  covered  in  as  much  detail  as  needed  (-01%) 


Illinois  Table  14A 

Male 


1 . 

not  enough  examples 

(79%) 

2. 

Important  Ideas  not  clearly  pointed  out 

(77%) 

3. 

relationships  between  important  ideas  not  pointed  out 

(77%) 

4. 

vocabulary  difficult  to  understand 

(76%). 

5. 

students  expected  to  know  more  than  thfey  do 

(76%) 

6. 

ideas  not  related  to  what  students  may  already  know 

(75%) 

7. 

more  information  included  than  necessary 

(75%) 

8. 

topics  not  covered  in  as  much  detail  as -needed 

{73%) 

9. 

ideas  organized  in  a  way  which  is  difficult  to  follow 

(70%) 

'  10. 

insufficient  background  information. 

(70%) 

11. 

good  chapter  summary  not  included 

(64%) 

12. 

text  out-of-date 

(52%) 

Female 

1. 

vocabulary  difficult  to  understand 

(82%) 

2. 

important  ideas  not  clearly  pointed  out 

(82%) 

3. 

students  expected  to  know  more  than  they  do 

(81%) 

4. 

relationships  between  important  ideas  not  pointed  out 

(79%) 

5. 

ideas  not  related  to  what  students  may  already  know 

(79%) 

6. 

topics  npt  covered  in  as  much  detail  as  needed 

(78%) 

■  7. 

more  information  included  than  necessary 

(75%) 

8. 

npt  enough  examples  ^ 

(72%) 

9. 

good  chapter  summary  not  included 

(71%) 

10. 

insufficient  background  information 

(63%) 

11. 

ideas  organized  in  a  way  which  is  difficult  to  follow 

(62%) 

.  12. 

text  out-of-date 

(49%) 

/ 


Table  14B 
minois 

Difference  between  Male  &  Female 

1.    ideas  organized  in  a  way  which  is  difficult  to  follow  (+08%) 

i.    insufficient  background  knowledge  (+07%) 

3.  not  enough  example  (+07%) 

4.  good  chapter  summary  not  included  (-07%) 

5.  vocabulary  difficult  to  understand  (-06%) 

6.  important  ideas  not  clearly  pointed  out  (-05%) 

7.  students  expected  to  know  more  than  they  do  (*-05%) 

8.  topics  not  covered  in  as  much  detail  as  needed  (-05%) 

9.  ideas  not,  related  to  what  students  may  already  know  (-04%) 

10.  text  out-of-date  (+03%) 

11.  relationships  between  important  ideas  not  pointed  out  (-02%) 

12.  more  information  included  than  necessary  (00%) 


ERIC 
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TABLE-  14C 


1 


Quest  ion 


Mean 


M 


Standard 
Devi  at  ton 

M  F 


never  a 
,prob I  em 

M  F 


some  t  i  mes 
a  problem 

M  F 


almost 
always  a 
prob I  em 

M  F 


a  1 ways 
a  problem 

M  F 


1.  The  text  uses  words  which  are 
diffiault  to  understand 

2.  The  text  does  not  tell  you 
which   ideas   in  the  chapter 
are  important;  that  is, 
which   ideas  you  should 
remember 

3.  The  text  does  not  tel|  you 
hovy  one   important  i  dea  J  s 
related  to  another  important 
i  dea 

The  text  does  not  explain  how 
nev/  ideas  arc  related  to 
things  you  already  know 

5.  The  text  organizes  ideas  in 
a  v-yay  which  is.  difficult  to 
fol low 

6.  The  text  does  not  include 
enough  backci round  information 
before   it  discusses  new. ideas 


1.8970  1,9835  .6/4OA  .6/435  .2^4 
2.1879    2.2m7      •91'46      .8866  .23 


2.1515    2.1429      .8876      .8287  .23 


2.1585  2.1703 


.9197 


,8'466  .25 


.9152     1.8^462      .7762°      .8333  .30 


l.9l'46    1. 8132 


7786 


18 


,6'4 


,18  .'46 


.21 


.21 


38 


.k5 


76^40    .30      .37  .5^ 


.69 

125) 

^47 


.^49 


52  .'45 


.'48 


.  10 

.10 

.02 

.03 

(17) 

(18) 

(3) 

(6) 

.20 

.2/4 

.  1  1 

.1  1 

(33) 

('♦3) 

(18) 

(20) 

.19 

.10 

.07 

(30 

(M) 

(16) 

(12) 

.20 

.23 

.  10 

.07 

(33) 

(^\) 

(17) 

(IM 

.  I'4 

.  12 

.Ok  ' 

.05 

(22) 

(21) 

(7) 

(10) 

.  1  1 

.12 

.05 

.03 

(19) 

(21) 

(8) 

(6) 
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TABLE  14C  (continued) 


Quest  ion 


Mean 


M 


Standard 
Devi  at  ion 

M  F 


never  a 
problem 


M 


somet  imes 
a  problem 


M 


a Imos  t 
always  a 
problem 

M  F 


always 
a  problem 


M 


7,  The  text  does  not  include 
enoqgh  examples  to  help 
you  understand  new  ideas 

8,  The  text  does  not  include 
a  good  summary  of  the 
important  ideas  in  the 
chapter 

9,  The  text  expects  you  to 
know  more  about  what  you 
are     reading  than  you 
usua I  1 y  do 

10.  The  text  does  not  discuss 
as  many  of  the   ideas  as 
the  teacher  expects  you 
to  know 

I  I .  The  text  spends  too  much 
time  discussing  ideas  the 
teacher  does  not  expect 
you  to  know 

12.  The  text  is  out-of-date-- 
that  is,  the  text  does  not 
discuss  current  issues 


2.02^    2.0055      .7509      .80^0     .21      .28      .60      ,'♦7      .13      .21       .06  .0^* 

(35)     (51)     (99)     (86)     (21)    (38)     (9)  (7) 


2.0^*85    2.093^    I  .0170 


2.2000    2.3791   V  .9383 


.91^6     .36      .29      .37      .^2      .\k      ,20      .13  .09 
(59)     (52)     (61)     (77)     (23)     (37)     (22)  (I6) 


.9828    .2^      .19      .^3      .^1       .21      ,23      .12  .17 
(^0)     (35)     (71)     (7M     (35)  -('♦2)     (19)  (31) 


2.1333    2,2253      ,953^      \3^S^     .27      .22      .kk      ,k(>      .17      ,19      ,12  .13 

(^5)  (73)     (83)     (27)     (3M     (20)  {2k) 


2.1515    I .9725 


.93^5 


1,7758    1,6703  .9^58 


,7A65     ,25      .25      .^7      ,56      J6      J5      .12  .0^* 
(kG)     (78)   (102)     (26)     (27)     (20)  (7) 


,8^417    .^8;     ,51      .37      .38      .05      ,0k      JO  .07 
(75)  ' (92)     (61)     (70)     (8)      (8)      (17)  (12) 
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Table  14D 
Biology  (Illinois  Part  II) 
Difference  between  males  &  females 

1.  more  information  included  than  necessary  (+15%) 

2.  insufficient  background  information  (+14%) 

3.  students  expected. to  know  more  than  they  do  (-12%) 

4.  ideas  not  related  to  what  students  may  already  know  (-09^) 

5.  vocabular)^tfficul t  to  understand  .  (-07%) 

6.  important  Tolas  not  clearly  pointed  out  (-06%) 

7.  ideas^  organized  in  a  way  which  is  difficult  to  follow  (+05%) 

8.  good  chapter  ^ufTinary  not  included  ^  (-04%) 

9.  topics  not  covered  in  as  much  detial  as  needed  (-02%) 

10.  text  out-of-date           '  (+02%) 

11.  relationships  between  Important  ide^is  not  pointed  out  (+01%) 

12.  not  enough  examples  \  (00%) 


Table  14?^ 
History  (Illinois  Part  II) 
Difference  between  males  &  females 


1;  not  enough  examples  (+12%) 

2.  ideas  organized  in  a  way  which  is  difficult  to  follow  (+10%) 

3.  good  chapter  summary  not  included  \       '  (-09%) 

4.  topics  not  covered  in  as  much  detail  asj' needed  (-07%) 

5.  important  ideas  not  clearly  pointed  out^  (-04%) 

6.  insufficient  background  information       \  (+04%) 

7.  text  out-of-date  (+04%) 

8.  vocabulary  difficult  to  understand  (-03%) 

9.  relationships  between  important  ideas  not  pointed  out  (-03^) 

10.  ideas  . not  related  to  what  students 'may  already  know  (-01%) 

11.  students  expected  to  know  more  than  they  do  (-01%) 

12.  more  information  included  than  necessary  (-01%) 


ERIC 


\ 


1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 
10. 
11. 
12. 


Table  14F 
niinois  Part  II 
Difference  between  History  males  &  Biology  males 


vocabulary  difficult  to  understand 
insufficient  background  information 
more  information  included  than  necessary 
not  enough  examples 

important  ideas  not  clearly  pointed  oiit 


ideas  not  related  to  what  students  may^alreSdy  know 
a  good  summary  not  included  ^ 
text  is  out-of-date 

relationships  between  important  ideas  not  pointed  out 
ideas  organized  in  a  way  which  is  difficulrxto  follow 
students  expected  to  know  more  than  they  do 
tdpic5  not  coy^ed  in  as  much  detail  as  needed 


(-14%) 
(-14%) 
(+08%) 
,(+07%) 
(+06%) 
(-06%) 
(-04%) 
(+02%)' 
(-0?%) 
(00%) 
(00%) 


3iO 


^Table  146 
Illinois  Part  II 
Difference  between  History  fsmale  &. Biology  female 

1.  vocabulary  difficult  to  understand        ^  (-20$) 

2.  students  expected  to  know  more  than  they  do  ,  (-13$) 

3.  Ideas  organized  In  a' way  which  Is  difficult  to  follow  (-07*) 

4.  relationships  between  Important  1deas,not  pointed  out  (+06$) 
text  is  out-of-date  (-06$) 

6.  Important  Ideas  not  clearly  pointed  out         ♦  (+05$) 

7.  topics  not  covered  In  as  much  detail  as  needed  (+05$) 
Insufficient  background  Information  (-04$2j 
not  enough  examples  '  (-04$) 
Ideas  not  related  to  what  students  may  already  know  (-02$) 
more  Information  Incli^ded  than  necessary  -  (-02$> 
a  good  summary  not  Included                         \      .       .  (-01$) 


5 


8 
9 

10 
11 
12 


ERIC 


Table  ISA- 

Collapsed  Frequency  of  Texas  Students  Responses  to  Survey 
,        •      «        ^;     "Part  III  ^  ' 


1.  remember  what  was  read  a  week  later  "  (87%) 

»                     /                  •,  ■ 

2.  concentrate  while  reading  ;  (75%) 

3.  ''''ftinow  how  well  information  read  will  be  remembered  (71%) 

4.  remember  what  was  read  a  ctey  later     -  /  (70%) 

5.  identify  relationships  betweer)  ideas   ^  (69%) 

6.  generate  questions  to  ^uide  reading  '  (69%) 
,  7.  construct  an  outline.          ^  *o  (64%) 

8.  summarize  chapter       •  (63%) 

9.  knoW  how  well  information,  read  is*  understood  *  (63%) 

10.  complete  tej^tbook  questions/activities  ,  (62%) 

11.  identify  imporf;arit  ideas           .              ^  (59%) 

12.  understand  difficult  vocabulary.'  \    ,  (59%) 

13.  prepare  for  exam  or  quiz                     V  (59%) 

14.  change'reading  rate  to  suit  purpose  '  (55%) 

15.  notetaking' after  reading  chapter  "  (54%) 

16.  notetaking  while  reading  ^  •  -  /  '  (50%) 
17.,  „  interpret  diagrams,  graphs,  etc.  -  "  (46%) 
18.  complete  teacher  questions/activities  (45%) 


• 

1 

\ 

TABLE  15B 

•  •.•./ 

Standard 
Deviation 

1 

2 

3 

>  \ 

5 

Quiestlon                ^  ^ 

N    '  'C 

Mean 

A  Lot  of 
Difficulty 

Some 
Difficulty 

Oecaslonaf 
Difficulty 

Karely  Any 
Difficulty 

. Never  Any 
Difficulty 

1. 

Identifying  Important  Ideas  4n 
the  chapter* 

2221^ 

3,2252 

I.0<i80 

.05 
(11) 

.20 
('('() 

'  (76) 

.30 
(66) 

;ii 

(25) 

A  ■ 

.07 
(18) 

\ 

Identifying  relationships 
between  ideas  In  the  chapter. 

271 

2.9889 

1.0309 

.08 
(22) 

.23 
(61) 

.38  \ 
d'oii) 

.2*1 

(66)  • 

3. 

Understanding  difficult 
vocabulary* 

271 

3.0738 

I.I8O9 

.11 
(29) 

.23 

(63)  ^ 

.^5 

(67)  f 

.30 
'  (83) 

.11 

^(29) 

ii. 

Ihterpret Ing  diagrams ,  graphs , ' 
etc. 

272 

3. '•338 

1 . 1666 

.08  ' 
(2-3) 

.12 
(33) 

.26 
(68) 

.36 

(99)  . 

.18 

^9) 

5. 

Constructing  an  outline  for 
the  Inforniation  In  th^ 
chapter. 

265 

-  j 

2.9736 

'  1.1755 

.13 

(3M  . 

.22 
(59) 

.29 
(77) 

.27 
(70) 

.09 
(25) 

6. 

Talking  notes  while  you  read  . 
' the  chapter  • 

d.3l68 

h  1*2575 

.11 

(29) 

.15 
CiO) 

.2i| 
(63) 

.30 
(79) 

.20 
(51) 

7. 

Talking  notes  after  you  have 
read  the  c^hapt^r. 

266 

3.27'»'« 

l.20§'i 

.11 
(28) 

.lii 
(38)^ 

.29 
(78) 

.29  ' 
(77) 

.17 
('»5) 

8. 

Summarizing  the  chapter  in. 
your  own  words . 

269 

2.9517 

1 .237A 

.|ii 
(i9) 

•  .2ii 

(6*1 )_ 

(  .25 
(68) 

.25 
(67) 

.12 
(31) 

9. 

Generating  questions  to  guide 

your  reading  of  the  chapter. 

■*> 

266 

2.9'»36 

1.0571 

.09 
'(25) 

(6'i) 

.36  • 
(95) 

i> 

.25 
(65) 

.06 

(J7) 

10. 

f 

Answering  questions  or 
complecting  ac 1 1  v i  t tes  the  . 
text  has  provided. 

270 
w 

3.1296 

1.1117 

.07 
(20) 

■ 

.22 
(59) 

.33 
(89) 

.26 
(70) 

.12 

(32) 

ERIC 


343 


344 


TABLE  15B  (continued) 


Standard 
Deviat  ion 

1 

2 

3 

V 

5 

Ques  1 1  on 

H 

Mean 

A  Lot  of 
Difficulty 

Some 
Difficulty 

Occasional 
Olfflculty 

Rarely  Any 
Olfflculty 

Never  Any 
Difficulty 

II. 

Answering  questions  or 
completing  activities 
the  teacher  has  provided. 

270 

3.'i630 

1^6259 

.05 
-  (13) 

.12 

(33) 

.28 
(76) 

M 
(112) 

ll*** 
(36) 

12 . 

Preparing  for  an  exam  or 
quiz. 

26/ 

3. 1 199 

1 . 1'»73 

.  12 
(31) 

.  16 

Ctz) 

.31 

m 

.31 

(8'.) 

.  ID 

(26) 

13. 

Changing  your  reading  rate 
(sl(imming»  previewing, 
reading  slowly)  with  your 
purpose  for  reading  and 
type  of  material  you  are 
reading . 

/  265 

3.23'»0 

1.1830 

.09 

(25) 

.17 

.29 
(76) 

.^o 

(78) 

1 

.15 

'  ikO) 

)k. 

Knowing  how  well  you  have 
either  understood  or  mis- 
understood what  you  have 
read. 

271 

3.1070 

I.l6t»l 

.09 

(25) 

.22 
(59) 

.32 
(85) 

(66) 

.13 
(36) 

15. 

Knowing  how  well  you  will 
be  able  to  remember  what 
you  have  read. 

270 

218778 

1  .1192, 

.  12 
(33) 

.25 

(67) 

.3't 
'  (91) 

.21 
(58) 

.08 

(21)  . 

16. 

Remembering  what  you  have 
read  a  day  later. 

270 

2.8778 

\.\hSS 

.13 
(3'») 

.26 
(70) 

31 

m) 

.22  ^ 
(59) 

.08 
(23) 

17. 

Remembering  what  you  have 
read  a  week  later'^. 

269 

2.l<»87 

1 .0367 

.32 

(85) 

.36 
(98) 

.19 
(SO) 

.12 
(33) 

.01 

(3) 

18. 

Concentrating  as  you  read 
the  chapter. 

270 

2.6111 

l.2'»08 

,2k 
(6<.) 

.2't 
(66) 

.27 

(73) 

.17 

.08 
(22) 

Table  16A  . 
(Illinois) 

1.  remember' what  was  read  a  week  later  (82.7%) 

2.  concentrate  while  reading  (74%)/ 

3.  identify  relationships  between  ideas  (63%) 

4.  know  how  well  information  read  will  be  remembered  (63%) 

5.  summarize  the  chapter  (61%) 

6.  prepare  for  exam  or  quiz  (61%) 

7.  remember  what  was  read^a  day  later  (59%) 

8.  know  how  well  information  read  is  understood  (59%) 

9.  identify  important  ideas  (57%) 

10.  understand  difficult  vocabulary  (57%) 

11.  construct  an  outline  (54%) 

12.  self-questioning  while  reading  (51%) 

13.  recall  something  to  relate  to  what  is  being  read  (51%) 

14.  complete  textbook  questions/activities  (49%) 

15.  complete  teacher  questions/activities  (45%) 

16.  change  reading  rate  to  suit  purpose  (41%) 

17.  understand  diagrams,  graphs,  etc.  (31%) 

18.  notetaking  (31%) 


4 


i 


TABLE  16B 


Que ^  f  i  on 

Me  a  n 

Standard 
Dev  i  at  i  on 

1 
1 

neve  r 

fj  i  f  f  i  r  II 1  f 

0 

L. 

h  a  r  H  I  v 

ever 
difficult 

7 
-> 

somet  imes 
H  I  f^f  t  ml  f 

ii 

•1 

ve  ry 

Hi  f  f  1  r  1 1 1  t 

1 . 

Identify   important  Ideas  'in 

2.5591 

.7322 

,  .08 

.35 

.50  ■ 

.07 

the  chapter 

'  (27) 

(122) 

(175) 

(23) 

2. 

Identify  hov>  ioiportant  ideas 

2-7081 

.7566 

.05 

.32 

.50 

.13 

are  related 

(18) 

(110) 

(173) 

3. 

Understand  difficult  words 

2.5'*  18 

.9252 

.17 

.26 

•'3  \ 

■  ■ 

(58) 

(90) 

(152) 

('*7)  > 

Understand  diagrams,  graphs, 

2  .05i9 

•9293 

.33 

.36 

■  :m 

.07  . 

etc. 

(MM 

(125) 

(2M 

5. 

Outline  the  Information  in 

2.5202 

.8687 

.13 

.33 

.hi  . 

.12 

the  chapter 

\ 

(115) 

^  C^i) 

6. 

Take  notes  from  what  you  read 

2.0838 

1  9669 

33 

36  ' 

2 1 

.  10 

in  the  chapter 

\ 

(MM 

(123) 

(75) 

(3M 

7 

junTnarize   tne  cnapLer    in  your 

.9010 

1  7 

tJ  w  n  w  u  r  u  b 

V  ^ 

8. 

Think          niit*<ition«%    t n 

2  .  ^4928 

16 

33 

37 

yourself  about  what  you 

(iiM 

(130) 

are  read  i  ng 

9. 

Recall   something  you  already 

2.'«8I3 

.9006 

.16 

.33 

.39 

.12 

know  that  will   relate  to  what 

(115) 

(135) 

(^3) 

you  are  readi  ng 

er|c  31» 


TABLE  16B  (continued) 


3  - 


Quest  ion 


Mean 


Standa  rd 
De V  i  a  t  i  on 


neve  r 
di  f f i  cul t 


hard  ly 
eve  r 
difficult 


somet imes       ,  very 
difficult  difficult 


10, 


I  I 


12 


Answer  the  questions  or 
complete  the  activities 
included   in  the  chapter 

Answer  the  questions  or 
co-^iplete  the  activities 
the  teacher  has  provided  ^ 

Change  your  reading  rate 
(skimning,  previewing, 
reading  slowly)  with  your 
purpose   for  reading  and  type 
of  material   you  are  reading 


13-   Prc:pare   for  an  exam  or  quiz 


1^4.    Knc;w  how  well   you  have  either 
understood  or  misunderstood 
what  you  have  read 

15-  Know  how  well  you  will  be 
able  to  remember  what  you 
have  read 


2.3786 


2.6686 


2.5620 


2.7262 


.8138 


,7526 


.9201 

,8135 


.12 
(M) 


.21 
(73) 


.  12 

,12 
(^^2) 


,06 

(22) 


.37 
(128) 


(I'^g) 


:38 
(132) 


.27 

(9M 

.29 

(102) 


.31 
(109) 


(1W) 


.^0 
(I'^O) 


.31 

(107) 


.k2 
(169) 


(158) 


.07 

(25) 


.05 

(16) 


.10 

(3M 


.  19 

(65) 

.10 

(3M 


.17 

(58) 


16.   Remember  what  you  have  read 
ct  day  lacer 


2. 67^4  ^4 


.8367 


.08 

(27) 


.33 

(115) 


(l^iS) 


.16 
(56) 


ERIC 


TABLE  16B  (contfnulsd) 

M  ,  ' 


Question 

Mean 

^fAnHArH 

Deviat  ion 

a 

1 

never 
di  f f icul t 

\i#     fill               \S     i  ^ 

2 

ha  rd 1 y 
ever 
difficult 

3 

sometimes  • 
difficult 

very 
dl f f icul t 

Remember  what  you  have  read 

3.2^78 

.006 

.^426 

a  week  later 

■      (2)  ' 

•  (58) 

\  (139) 

(U8) 

18. 

Concentrate  as  you  read  the 

2.9395 

.8530 

.06 

.20 

.27 

chapter 

(23) 

(68) 

(163) 

(93) 

IV 


3rj 


Texas 


TABLE  17A  - 


BIOLOGY 


HISTORY 


1.  ^  remember  what  was  read  a  week  later 

2.  concentrating  while  reading 

3.  know  how  well  information  read  will  be 
remembered 

4.  identify  relationships  between  ideas 

5.  generate  questions  to  guide  reading 

6.  remember  what  was  read  a  day  later 

7.  complete  textbook  questions/activities 

8.  construct  an  outline^ 

9.  summarize  the  chapter 

10.  know  how  well  information  read  is  understood' 

11.  i/nderstand  difficult  vocabulary 

12.  identify  important  ideas 

13.  prepare  for  exam  or  quiz 

14.  change  reading  rate  to  suit  purposes 

15.  notetaking  after  reading  chapter 

16.  notetaking  while  reading 

17.  interpret  diagrams ♦  graphs,  etc. 

18.  comp)^fe  teacher  questions/activities 


(76%) 

(72%) 
(71%) 
(71%) 
(68%) 
(66%) 
(65%) 
(65%) 
(65%) 
(64%) 
(62%) 
(62%) 
(57%) 
(55%) 
(54%) 
(47%) 
(46%) 


1.  remember  what  was  read  a  week  later  (88%) 

2.  remember  what  was  read  a  day  later  '(74%) 

3.  V  concentrating  while  reading 

4.  identify  relationships  between  ideas  (65%) 

5.  know  how  well  information  will  be  ^ 
remembered  (65%y 

6.  generate  questions  to  guide  reacting  (64%) 

7.  construct  an  outline  (61%) 

8.  summarize  the  chapter  (60%) 

9.  know  how  well  information  read  is 
understood  (56%) 

10.  notetaking  after  reading  chapter  (53%) 

11.  identify  important  ideas  (51%) 

12.  complete  textbook  questions/activities  (51%) 

13.  prepare ^for  exam  or  quiz  (50%) 

14.  change  reading  rSite  to  suit  purposes  (50%) 

15.  understand  difficult  vocabulary  (44%) 

16.  complete  teacher  questions/activities  (44%) 

17.  interpret  diagrams,  graphs,  etc.  "  (41%) 

18.  notetaking  H^hile  reading  chapter  (40%) 


ERIC 


TEXAS  .   ':        '    TABLE  17:B 

Difference  between  Biology  &  History 


1. 

understand  difficult  vocabulary       .  ■ 

(-20%) 

.2. 

complete  textbook  questions/activities 

(-15%) 

3. 

notetaking  while  reading  chapter 

(rl4%) 

4. 

preparing  for  exam  or" quiz 

(-12%) 

5. 

identify  important  ideas  >  -  ' 

(-11%) 

^ 

know  how  well  information  read  is  understood 

(-09%) 

7. 

generate  questions  to  guide  reading 

(-07%) 

f 

8. 

change  reading  rate  to  suit  purpose 

{-07%) 

9. 

know,  how  well  information  iread  will  be  remembered  v. 

(-07%) 

10. 

identify  relationships  between  ideas 

(-06%) 

11. 

interpret  diagrams,  graphs,  etc. 

(-06%) 

12. 

remember  what  was  read  a  day  later 

(+06%) 

13. 

summarize  the  chapter 

(-05%) 

14. 

construct  an  outline 

(-04%) 

15. 

concentrate  while  reading  ^. 

,(-04%) 

16. 

notetaking  after  reading  chapter 

(-02%) 

17. 

complete  teacher  questions/activities  . 

(-02%) 

18. 

remember  what  was  read' a  .week  later  ^ 

(+02%) 

(     •  (■  . 


ERIC 


TABLE  17C 


Questions 


Hean 


Standard 
Oevlat Ion 


1 


3 


A  Lot  of 
Difficulty 


Scene  Occasional      Rarely  Any 

Difficulty      Difficulty  Difficulty 


Ne^er  Any 
Difficulty 


B 

H 

■  1 — 
B 

H 

B 

H 

B 

H 

B 

H 

B  ' 

H 

B 

H 

B  . 

H> 

•• 

Identifying  Important,  I'deas 
In  the  chapter.  * 

167 

55 

3.1377 

3.«i909 

I.OI166 

1 .0160 

.06 
(10) 

.02 
(1) 

.22 
(36) 

.15 

.(8), 

.3«i 
(57) 

.3* 
I19) 

•  29 
(«i9) 

.31 
(17) 

.09 
]II5) 

.18 
(10) 

2. 

Identifying  relationships 
between  Ideas  In  the  chapter. 

202 

69 

2.955*1 

3.0870 

1:0138 

I.08II 

.09 
(17) 

.07 
(5) 

.23 
('•6) 

.22 
(15) 

.39 
(79) 

.36 

(25). 

.2V 
(<19) 

.25 
(17) 

.05 
.  (II) 

.10 

(7)  ' 

Understanding  difficult 
vocabulary . 

203 

68 

2.9606 

3.'»IT8 

1.18^2 

1.0959 

.12 
(25) 

.06 
C) 

.26 
(52) 

.16 
(II) 

.26 
(52) 

.22 
(15) 

.27 
(5M 

.'•3 
(29) 

.10 
(20) 

.13 

(9) 

k. 

Interpret  i  ng,-  dt agrams ,  graphs  ,203 
etc.  . 

69 

3.3990 

3.5362 

I.I66I 

1.1705 

.08 
(17) 

.09 
(6) 

.13 
(27) 

.09  v 

(6) 

.{6 
(52) 

•  23 
(16) 

.36 
(72) 

.39 
(?7) 

.17 
(35) 

.20 
(14) 

5. 

Constructing  an  outline  for 
the  information  In  the 
chapter , 

198 

67 

2.95^5 

3.0299 

M368 

J  .2^906 

.11 
(22) 

.18 
(12) 

.25 
(50) 

.13 
(9)- 

.29 
(57) 

.30 
(20) 

.27 
(53) 

.26 
(17) 

.08 
(16) 

.13  V 
(9) 

6, 

Taking  notes  while  you  read 
the  chapter . 

19^ 

68 

3.2526 

'3.5000 

1.2522 

1.2637 

.12 
(23) 

.09 
(6) 

.15 
(29) 

.16 
(II) 

.  '27 
(^3) 

.15 
(10) 

•  .28 
(5«t) 

.37  ' 
(25)" 

-.18 
(35) 

.23  , 
(16) 

7. 

Tailing  notes  after  you  have 
read  the  chapter. 

198 

68 

3.2^175 

3.3529 

1.1769 

1.3017 

.10 
(19) 

,13  ► 
(9) 

.16 
(32) 

.09 
(6) 

.29 

•  (5» 

:ii 

(21) 

i3K 
(61) 

.235 
(16) 

.l<i 

.(29) 

.2  35  > 
(16)^ 

8. 

Summarizing  the  chapter  in 
your  own  words. 

202 

67 

2.9208 

3.0li48 

I.219I 

1.2961 

.It| 
(29) 

.15 
(10) 

.25 
(50) 

.21 

(iM 

..26 
(52) 

.2«i' 
(16) 

.25 
(50) 

•2.5/ 
(17) 

.10 
( 2J ) 

v.* ' 

'   .15  ' 
(10) 

9. 

dene  racing  questions  to  guide 
your  reading  Q.f  the  chapter. 

198 

68 

2.8939 

3^0882 

1.034^ 

I.I  162 

.10 
(19) 

.09 
(6) 

.25 
(50) 

.21 
(IM 

.36 
(72) 

.3'' 
(23) 

.2«i 

:26 
(18) 

.05 

i»o) 

n 
M7)  ^ 

Id. 

Answering  questions  or 
c6m(^leting  activities  the 

203 

67 

3.0iE|iEi3 

3.3881 

l.077> 

I.I80I 

.07 
(15) 

.08 
(5) 

.2i| 
('•9) 

.15 
(10) 

.35 
(70) 

.28 
(19) 

.25  u 
(50). 

.30 

(20), 

ft 

.09 

(19) 

0  3)  ,».'  . 

text  has  provided. 


ERIC 


3^57 


358 


TA8LE  17C  (continued) 


I 


Hean 


Ques  C  i  ons 


Standard 
Deviation 


A  lot  of 
Difficulty 


Some  Occasional      Rarely  Any 

Difficulty      Difficulty  Difficulty 


Never  Any 
Difficulty 


1 

B 

H 

H 

B 

H 

B 

H 

B 

H 

B 

H 

B 

H 

B-  •• 

M 

1 1 . 

Answering  questions  or 
completing  activities 
the  teacher  has  provided. 

202 

68 

3.W57 

3.5735 

1 .OMOO 

(10) 

nil 
(3) 

1  c 
(29) 

.UD 
(<«) 

(53) 

.34 
(23) 

% 

(85) 

(27) 

.  12 
(25) 

16 
(II)  • 

12. 

Preparing  for  an  exam  or 
quiz. 

199 

68 

3. 0503 

3.  3235 

l.|J|Ji8 

1 .1387 

.13 

(25) 

.09 
(6) 

.16 
(33) 

.13 

In  \ 

(9) 

.33 
lo5l 

.28 

( 19) 

.30 

tea  \ 

.37 

.08 
\  1  /J 

.13 

\^  9 

13. 

Changing  your  reading  rate 
(si(  immi  ng previewing, 
read 1 ng  s 1 ow 1 y )  with  your 
purpose  for  reading  and 
type  of  material  you  are 
reading . 

199 

66 

3.1960 

3.3'*85 

1  .2172 

1 .07'4l 

.11 
(21) 

.06 

W 

.18 
(36) 

.15 
(10) 

.28 
(57) 

.29 
M19) 

.27 
(S3) 

.38 
(25) 

.16 
(32) 

M2 
(8) 

\k. 

Knowing  how  well  have 
either  understood  or  mis' 
understood  what  ybu  have 
read. 

202 

69 

3.05*15 

3.2609 

r 

1.1811 

1 . 1068 

.10 
(20) 

.07 
(5) 

.2*4 

('«8) 

.16 
(II ) 

.31 
(62) 

.33 
(23) 

.22 
(M5) 

.31 
(21 } 

.13 

(27; 

.13 

15. 

Knowing  how  well  you  will 
be  able  to  remember  what 
you  have  read. 

201 

69 

\ 

^8507 

2.9565 

1 .0989 

1 .1812 

.11 
(23) 

(10) 

.11 

(5'») 

.19 
(13) 

.3't 
(69) 

.32 
(22) 

.20 
('•O) 

.26 
(18) 

.08 
(15) 

.09 

(6)  • 

16. 

Remembering  what  you  have' 
read  a  day  later. 

201 

69 

2.8806 

2 . 8696 

1 .19'«0 

9987 

(28) 

.09 
(6) 

.26 
(52) 

.26 
(18) 

.28 
(57) 

.39 
(27) 

.22 
{^^) 

.22 
(15) 

.10 
(20) 

.Ok 
(3) 

17. 

Remembe*ring  what  you  have 
read  a  week  later. 

201 

68 

2. 129'« 

2.2059 

1 .0598 

.9706 

.33 
(67) 

.27 
(18) 

.36 
(72) 

.38 
(26) 

.17 
(3'») 

.23 
(16) 

.12 

(25) 

.12 
(8) 

.02 
(3) 

.no 
((») 

18. 

Concen  t  ra  t  inc)  as  you  read 
the  chapter. 

201 

69 

2.5672 

2.7391 

1 .2*437 

1 .2326 

.25 
(50) 

.20 

(IM 

.25 
(51) 

.22 
(15) 

.26 
(52) 

.30 
(21) 

.16 
(32) 

.19 
(13) 

.08 
(Ij6) 

■  Ot 
(6) 

ERIC 


3  GO 


Illinois  TABLE 


 BIOLOGY 

1.  remember  what  was  read  a  week  later  (85%) 

2.  prepare  for  exam  or  quiz  ^  (73%^' 

3.  concentrate  while  reading  (73%) 

4.  understand  difficult  vocabulary  (67%) 

5.  Identify  relationships  between  Ideas  (66%) 

6.  know  how  well  Information  read  will  be 
remembered'     "  (63%) 

7.  summarize  the  chapter  (63%) 

8.  remember  what  was  read  a  day  later  (59%) 

9.  complete  textbook  questions/activities  (58%) 

10.  know,  how  well  Information  read  Is 

understood  (58%) 

11.  identify  important  Ideas  (56%) 

12.  construct  an  outline  (56%) 

13.  recall  something  to  relate  to  what  is  being 

read  .  (55%) 

14.  self-questioning  while  reading  (52%) 

15.  complete  teacher  questions/activities  (50%) 

16.  change  readlhg  rate  to  suit  purposes  (48%) 

17.  understand  diagrams,  graphs,  etc.  (35%) 

18.  notetaking  '  (32%) 


8A 


HISTORY 


remember  what  was  read  a  day  later  .  (8J%) 

concentrate  while  reading  (73%) 

3,  know  how  well  Information  read  will  be 
remembered  (62%) 

4,  Identify  relationships  between  Ideas  (61%) 

5,  know  how  well  Information  read  Is  understood  (59%) 

6,  remember  what  was  read  a  day  later  (59%) 

7,  summarize  the  chapter  (59%) 

8,  Identify  Important  Ideas  (58%) 

9,  prepare  for  exam  or  quiz  (52%) 

10.  construct  an  outline  (51%) 

11.  self-questioning  while  reading  (51%) 

12.  understand  difficult  vocabulary  (50%) 

13.  recall  something  to  relate  to  what  Is  being 

read  (49%) 

14.  complete  textbook  questions/activities  (44%) 

15.  complete  teacher  questions/activities  (42%) 

16.  change  reading  rate  to  suit  purposes  (36%) 

17.  notetaking  (31%) 

18.  understand  diagrams,  graphs,  etc.  (28%) 


Illinois 


TABLE  18B  ' 
Difference  between  Biology  &  +H.i story 


1.  prepare  for  exam  or  quiz  - 

2.  understand  difficult  vocabulary 

3.  complete  textbook  questions/activities 

4.  change  reading  rate  to  suit  purposes  ': 

5.  complete  teacher  questions/activities 

6.  understand  diagrams,  graphs,  etc.  ' 

7.  recall  something  to  relate  to  what  is,  being  read 

8.  identify  important  ideas  - 

9.  construct  an  outline 

10.  summarize  the  chapter 

11.  remember  what  was  read  a  week  later 

12.  identify  important  ideas 

13.  .  notetaking 

14.  self-questioning  while  reading 

15.  kriow  how  well  information  read  is  understood 

16.  knowhowwell  information  will  be  remembered 

17.  concentrate  while  reading 

18.  remember  v^at  was  read  a  day  later 


(-21%) 
(-17%) 

^  (-14%) 
(-12%) 
(-08%) 
(-07%) 
(-06%) 
(-05%) 
(-05%) 
(-04%) 
(-04%) 
(+02%) 
(-01%) 
(-01%) 
(+01%) 

•  (-01%) 
(+01%) 
(00%) 


ERIC 


TABLE  18C 


Question 


Mean' 


Standard 
Devi  at  ion 


never 
difficult 


hardly  • 
ever 
difficult 


somet  imes 
difficult 


ve  ry 
diff icul t 


H 


B 


H' 


B 


H 


B 


H 


B 


H 


B 


H 


1.  Identify  important  ideas  in 
the  chapter 

2.  Identify  how  important  ideas 
are  related 

3.  Understand  difficult  v/ords 

k.  Understand  diagr^s,  graphs, 
etc  . 

5.  Outline  the  information  in 
the  chapter 

6.  Take  notes  from  what  you  read 
in  the  chapter 

7.  Summarize  the  chapter   in  your 
own  words 

8.  Think  of  questions   to  ask 
yourself  about  what  you 
are  reading 

9.  Recall   something  you  already 
know  that  will   relate  to  what 
you  are  reading 


2. 552^4 
2.7622 
2. 7^483 
2.2028 
2.5352 
2.1197 
2.7113 
2. 5^*23 


2.5637 
2.6700' 

2.3971 
1 .3ke\ 
2.5098 
2.0588 
2.6176 
2.i458l 


ERIC 


.6573  .7821 

.7312  .7736 

.8'«3I  .95'<2 

.900^4  .9216 

.30kk  .8kS\ 
.9262    •  .9958 

.9193  .8883 

.9^1 19"  .918^* 


2.5315    2.'4'46l  .9178 


8889 


.05 
(7) 

.10 

(20) 

.39 
(56) 

.32 
(66) 

.52 

^  (Ik) 

.50 
(101) 

.Ok 
(6) 

.08 
(17) 

.03 

(5) 

.06' 
(13) 

.31 

(kk) 

.33 
(66) 

.52 
(Ik) 

M 
(99) 

.\k 
(20) 

.12 
(25) 

.09 
(13) 

.22 
(kS) 

.2k 
(3M 

.28 
(56) 

.50 
(72) 

.39 
(80) 

.17 

(2k) 

.  1  1 

(23) 

.2k 
(3k) 

.39 
(80) 

.k\ 
(58) 

.33 
(67) 

.27 
(39) 

.22 
('*5) 

V 

.08 
(12) 

.06 
(12) 

.16 
(22) 

.  12 
(2k) 

* 

.28 

(ko) 

.37 
(75) 

M 
(62) 

.ko 
(82) 

.13 

(18) 

.  1  1 

(23) 

.29 
(k\) 

.36 
(73) 

.39 
(55) 

.33 
,  (68) 

.2k 
(3M 

.  .20 
(k\\ 

.08 
(12) 

.  1 1 

(22) 

.12 
(17) 

.12 

(25) 

.25 
(35) 

.29 

(59)* 

M 
(62) 

.kk 
(89) 

.2D 
(28). 

.15 
(31) 

.13 

(19) 

.17 

(35) 

.35 
,('*9) 

.32 
(65) 

.37 

(52) 

•  39  . 
(78) 

.15 

("2  2 ) 

.12 

(25,) 

.15 
(22) 

.16 
(32) 

.30 
(k3) 

.35 
(72) 

.k\ 
(58) 

.38 

(77) 

.\k 
(20) 

.n 

(23). 

3B'J 


TABLE  18C  (continued) 


1 

2 

3 

k 

Quest  ion 

Mean 

Standard 
Dev  i  at  ion 

never 
difficult 

hardly 
ever 
difficult 

somet  imes 
difficult 

very  . 
difficultV 

B 

H 

B 

H 

B 

H 

B 

H 

a 

B 

H 

10 

.   Answer  the  questions  or 
complete  the  activities 
included   in  the  chapter 

2 

2 

.3137 

.7135 

.859'< 

.06 
(8) 

.19 
(39) 

.36 
(52) 

.37 
(76) 

.50 
(72) 

.37 
(75) 

.08 
(11) 

.07 
(IM 

1 1 

.  Ansvver  the  quest  ibiris  or 
complete  the  activities 
the  teacher  has  provided  ,^ 

2 

2 

.3039 

.7019 

•  7789 

.06 
(9) 

.16 
(32) 

.kk 
(63) 

.k2 
(86) 

(62) 

.38 
(78) 

.06 
(8) 

.oi» 
(8) 

12 

Change  your  reading  rate 
^skimming,  previewing, 
reading  slowly)  with  your 
purpose*  for  reading  and  type 
of  material'  you  are  reading 

2 

.  38^46 

2 

.2315 

.8875 

.9231 

.18 
(26) 

.23 

iUS) 

.k\ 
(83) 

« 

.39 
(55) 

.26 
(52) 

.09 
(13) 

.  10 
(21) 

f 

13 

Prepare  for  a.n  exam  or  quiz  * 

* 

2 

.8322 

2 

.5539 

.8306 

.963V 

.08 
(12) 

.15 
(31 ) 

.19 
(27) 

.33 
(67) 

(77) 

.33 
(68) 

.19 
(27) 

.19 
(38) 

\k 

Know  how  well  you  have  either 
urrde  rs  tood  or  mis  unders  tood 
what  you  have  read 

2 

2 

5588 

.7922 

.85'<7 

.11 
(15) 

.13 

(27) 

.31 
ikk) 

.28 
(58) 

.50 
(72) 

(97) 

.08 
(12) 

.1  1 
(22) 

15. 

Know  how  we  1 1   you  wi 1 1  be 
able  to  remember  what  you 
/lave  read  .                      '         '  ^ 

692; 

2  . 

7500 

.7620 

,8i488 

.05 
(8) 

.07 

(IM 

.32 

.31 
(63) 

.50 
(71) 

.U3 
(87) 

.13 
(18) 

.19 

m 

16. 

-  Remember  v/hat  you  hav6  read 
a  day  J  ater 

2. 

66^4  3 

2  . 

68l<« 

.7956 

.8661 

.06 
(9) 

.09 
(18) 

.35 
(50) 

f 

.32 
(65) 

.US 
(6M 

.U2 

(85) 

.]k 
(20) 

.17 

(36) 

V 


•TABLt  18C  (continued) 


Que  s  t  i  on 


Mean 


Standard 
Devi  at  ion 


never 
di  ff  icuU 


hard ly 
ever 
difficult 


somet  imes 
difficult 


very 
difficult 


B 


H 


B 


H 


B 


H 


B 


H 


H 


a,  week  latpr 

Concentrate  i 
chapter 


70i*3 

.7760 

.00 

.01 

.15 

.18 

.'♦5 

.37 

(0) 

(2) 

(22) 

(36) 

(6M 

(75) 

(57) 

(91) 

B33t* 

.8675 

.06 

.07 

.21 

.19 

.'♦9 

.'♦5 

.2'* 

.29 

(9) 

(30) 

(38) 

(70) 

(93) 

(3M 

(59) 

ERIC 


n 


^Texas  ,  -  •       TABLE  19A 


/  Me 

FEMALE 

1.. 

remember  what  was  reiid  a  week  later 

(82.2%) 

1. 

remember  what  was  read  a  week  later 

(91%) 

2. 

concentrate  while  readi rig 

(68%) 

2. 

^concentrate  while  reading 

(82%) 

3. 

geneijate  questions  to  gUide  reading 

(66%) 

3. 

remember  what  was  read  a  day  later 

,  (80%) 

4.. 

/complete  textbook  questions/activities 

(66%) 

4. 

know  how  well  information  read  will  be 

5. 

know  how  well  informatioh  read  will  be 

remembered 

f76%) 

remembered  ,        \              ;.  •  *  w 

(65%) 

5. 

identify  relationships  between  ideas 

(73%) 

6. 

identify  relationships  between  ideas 

(64%) 

6. 

•> 

.generate  questions  to  guide  reading 

.  (72%) 

7. 

construct  an  outline  A 

(62%) 

7. 

khow  how  well  information  read  is 

8. 

summarize  the  chapter 

(60%) 

unoerSLOOG 

9. 

prepare  for  exam  or  quiz  ^ 

(59%) 

O. 

construct  an  outlinb 

1  c  tv  \ 

•^10. 

remember  wh^t  was  read  a  day  later 

(57%) 

Q 
7  • 

summarize  tne  cnapter 

VO/*;  ■ 

11. 

know  how  well  information  read  is 

iU  • 

laenti ry  imporLan L  laeas 

#ci<y  \ 

undersjtqod 

(56%) 

11. 

prepare  for  exam  or  quiz 

i^9%) 

12. 

identify  important  ideas 

(55%) 

12. 

notetaking  after  reading  chapter 

(58%) 

13. 

'change  reading  rate  to  suit  purpose 

(55%)  » 

13. 

compjet?  textbook  questions/activities 

(58%)' 

14. 

understand  diffil^ult  vocabulary 

(53%) 

14. 

change  reading  rate  to  suit  purpose 

(57%) 

15. 

notetaking  while  reading 

(53%) 

15. 

understand  difficult  vocabulary 

(53%). 

16. 

notetaking  after  reading  chapter 

(50%) 

16. 

interpret  diagrams,  grapfis,  etc. 

(53%) 

17. 

complete  teacher  questions/activities 

(47%) 

17. 

notetaking  while  reading  - 

(47%) 

18. 

interpret  diagrams,  graphs,  etc. 

■ «» 

(37%) 

18. 

complete  teacher  questions/activities 

u                                                                                 •  ^ 

J,         •  .   ■              ^              '          '                          '  ^ 

'  (43%) 

Texas 


TABLE  19B       ,      '  ' 
Difference  between  +niale  &  female 


1  ; 

rcHicinucr  Vfiiab  was  rcau      uajr  *^J^^ 

(-23%) 

\      .fm       to  f 

o 

(-16%) 

concen  urauc  wm  1  c  reauing 

(-14%) 

A 

Know  now  WSI  l   iriTormauion  reciu  ib  unucrbLuuu 

c 

Know  now  Wcii  inTonnauion  reau  wi  1 1  oe  reineinoereu . 

c 
p* 

4  /4 AVI ^ 4         v«A  1  a^4nvicl^4nc    Ka^isi 4  /4a a c 
1 Q6n LI Ty  rc i a ul Onsn 1 pS  Dc uWccn  1 Ucdb 

f-09%) 

4/4Avi^4'Pt/    4  mnA  v*^  a  n  ^    4  /4a^  c 

1  ucn L 1  Ty  iinporLan L  i ucab 

(-08%) 

o 

(-08%) 

Q 

^/^nrmlA^A    ^av^KaaI/    miAC^4nnc  /a^^4\/1^lAC 

COinp  1 6 Lc   LcXuDuOK  qUcS  Ll  ons/  dULl  V  I  L  Icb 

f+oa?K) 

in 

rcHiciTiuc^r  WiidL  wdb  rcdu  d  wcciv  iducr 

(-08  8%) 

bUllliKiri^c  Liic  Uiidpuci  I 

(-07%) 

noteuaKing  wniie  reduTng 

f+06%) 

13. 

generate^ cmestlons  to  guide  reading 

14. 

construct  an  outline 

(-05%) 

15. 

complete  teacher  questions/answers- 

(+04%) 

16. 

change  reading  rate  to  suit  purpose 

(-02%) 

17. 

understood  difficult  vocabulary 

(00%) 

18. 

preparing  for  exam  or  quiz 

(00%) 

V 


TABLE  19C 


I  2  3 


Hean  Standard     \      —   

—  .  Deviation  A  Lot  of  Some  Occasional      Rarely  Any       Never  Any 

Questions  »  Difficulty      Difficulty      Difficulty      Difficulty  Difficulty 


H 

p 

p 

11 

p' 

H 

F 

H 

F 

H 

F 

H  ■ 

•  F 

1. 

Identifying  important  Ideas 
In  the  chapter. 

1 10 

112 

3.3636 

3.0893 

1  .0381 

1 .0'i'i5 

•  .O'l 
(1) 

.06 
(7) 

.16 
(18) 

.23 
(26) 

.35 
(38) 

.3*1 
(38) 

.31 
(3't) 

^29 
(32) 

.C 
(16) 

.08 
(9) 

2. 

Identifyln9  relationships 
between  Ideas  In  the  chapter. 

127 

l<i<i 

3. 1181 

2.8750 

1.0512 

1 .0026 

.08 
(10) 

.08 
(1^ 

.70 
(22ft 

.27 
(39) 

.39 
('•9) 

.38 
(55) 

.28 

(35) 

.22 
(31) 

.08 
(II) 

.05 
(7) 

3. 

Understanding  difficult 
vocabulary,. 

i\ 

128 

I'i3 

3.2500 

2.9I6I 

1.1570 

M838 

.08 
(10) 

.08 
(19) 

J 

(2/) 

.18 

(37) 

.2't 
(31) 

.27 
(36) 

if 

.3't 

CM 

.33 
(39) 

.13 
(17) 

.C 
(12) 

ti. 

Interpreting  diagrams »  graph^»l29 
etc. 

l'»3 

3:612'* 

3.2727 

1 .0991 

1.2055 

.06 
(8) 

.  10 
(15) 

.09 

(12) 

.15 
(21) 

.22 
(28) 

.28 
CO) 

.'•3 
(55) 

.31 
(••M 

.20 
(26) 

.16 
(23) 

5. 

Constructing  an  outline  for 
the  information  In  the 
chapter. 

126 

139 

3.0556 

2.8993 

1.1887 

1.1628 

.10 
(12) 

.16 
(22) 

26 
(33) 

.19 
(26) 

.26 
(33) 

.32 

.25 
(32) 

(38) 

.13 
(16) 

.06 
(9) 

6. 

Taking  notes  while  you  read 
the  chapter.  .? 

123 

139 

3. 15'*5 

3.'i60'i 

1 .3'(3I 

1 . 1626 

.16 

(^o) 

.06 
(9) 

.  16 
(20) 

(20)  . 

.21 
(26) 

.27 
(37)  • 

.28 
(35) 

.32 
(••M 

.19 
(22) 

.21 
(29) 

7. 

Taking  notes  after  you  have 
*  read  the  chapter. 

126 

ItiO 

3.2937 

3.2571 

1 .2203 

1 .2017 

ri  1 
(IM 

.  10 

(111) 

.  C 
(IB) 

(20) 

.25 
(31) 

.3'. 
C7) 

.3'. 
C3) 

.2't 
(3M 

.16 
(20) 

.18 
(25) 

8. 

Summarizing  the  chapter  in 
your  own  words . 

127 

I'i2 

3.0866 

2.8310 

1.2537 

1 .2l'i'i 

.13 
(16) 

.16 
(23) 

.21" 
(27) 

.26 
(37) 

.26 
(33) 

.25 
(35) 

.25 
(32) 

.25 
(35) 

.15 
(19) 

.08 
(12) 

9. 

Generating  questions  to  guide 
your  reading  of  the  chapter. 

127 

139 

3.0236 

2.8705 

.  I.I37I 

.9768 

.11 
(I'l) 

.08 
(11) 

.20 
(25) 

.28 
(39) 

.35 
('•5) 

.36 
(50) 

.2't 
(30) 

.25 
(35) 

.10 
(13) 

.03 
Ct) 

10. 

Answering  questions  or- 
completing  activities  the 

129 

I'll 

3.1135 

1.0391 

1.1777 

.05 
(6) 

.  10 

(U) 

.21 
(2B) 

.22 
(31)- 

.1)0 
(51). 

.26 
(38) 

.22 
(29) 

.30 
Ctl) 

.12 
(15) 

.  li. 
(17) 

text  has  provided. 


373  V 


TABLE  19C  (continued) 


1 


5 


Mean 


Standard 
Devi  at  Ion 


Questions 


A  Lot  of        '    Sow  Occasional      Rarely  Any       Never  Any 

Difficulty     Difficulty     Difficulty     Difficulty  Pif^culty 


n 

c 

T 

H 

F 

M 

F 

H 

F 

N 

F 

M 

F 

H 

F  ' 

H 

F 

1 1 . 

Answering  questions  or 

128 

I<i2 

3. '1718 

1 .0638 

.99'«3 

.05 
(7) 

(6) 

1 1 

•  1 1  * 

(15) 

(18) 

•  J* 
(39) 

.26 
(37) 

.37 

M 
(65) 

.16 

(20) 

.11 
(16) 

completing  activities 

If 

the  teacher  has  provided. 

.10 
(13) 

.09 
(13) 

1  2 . 

Preparing  for  an  exam  or 

I2'i 

/ 

3.1613 

3.0839 

1.1290 

1 . I658 

.  10 
(13) 

.  1  3 
(10) 

f  1  ft  \ 

1^*  9 

.29 

.31" 
(38) 

.32 

quiz. 

.18 
(23) 

.  12 
(17) 

Changing  your  reading  rate 

127 

138 

3.2520 

3.2r7'» 

1  .253'i 

1 . 1 188 

.  12 
(15) 

.07 
(10) 

.15 
(19) 

.20 
127) 

.28 

.30 
(til  \ 

.27 
()S) 

.31 
(ii3) 

fcklmmtno  orevicwino. 

I 

reading  slowly)  with  your 

purpose  for  reading  and 

/ 

r  w  nm    r\f    mut  fC  i  a\    VOU  are 

reading . 

.15 
(19) 

.12 
(17) 

Knowing  how  well  you  have 

128 

/ 

M 

3.2500 

2.9790 

1.  1570 

1 . 1596 

.08 
(10) 

.  10 
(15) 

(2m  ) 

.2*1 
(35) 

.29 

.3^ 

(ii8) 

.29 
(18) 

.20 
(28) 

either  understood  or  mis- 

understood what  you  h^vc 

read . 

s 

18 

^6) 

.10 
(13) 

.06 
(8) 

15. 

Knowing  how  well  you  will 

128 

3. 0^5 

2.7113 

1  . 1065 

1 . 1082 

.09 
(ID 

.  16 
(22) 

.22 
(28) 

.27 
(39) 

.  J** 

.  33 
('»7) 

25  ■ 
(32) 

be  able   to  remember  what 

you  have  read. 

.06 
(B) 

16. 

Remembering  what  you  have 

127 

iM 

3.2205 

2.573'* 

1 .0832 

1  .116^1 

.05 
(7) 

.19 
(27) 

.21 
(27) 

.30 
(M) 

'  .31 
(39) 

.31 
('15) 

.31 

(39) 

.Hi 
(20) 

.12 
(15) 

read  a  day  later. 

.008 
(1) 

.01 

(2) 

17 

Remembering  what  you  have 

126 

2.ti365 

1 .8951 

1  .0237 

.9838 

.20 
(25) 

.^12 
(60) 

.36 

.37 
(53) 

.262 
(33) 

.12 
(17) 

.17 
(22) 

.08 
(II) 

read  a  wcetc  later . 

.12 
(15) 

.05 
(7) 

18 

.   Concentrating  as  you  read 

128 

2.9297 

2.3239 

1.2179 

1  .I9'«2 

.15 
(19) 

.32 
('•5) 

.21 
(27) 

.27 
(39) 

.32 
CI) 

,23 
(32) 

.20 
(26) 

.13 
(19) 

the  chapter. 

Texas-Part  III  TABLE  19D 

Biology 

Difference  between  -Hnale  &  female 

1.  remember  what  was  read  a  day  later  (-26%) 

2.  identify  important  ideas  ^  (-21%) 

3.  concentrate  while  reading  (-19%) 

4.  interpret  diagrams,  graphs,  etc.  (-18%) 

5.  understand  difficult  vocabulary  (-16%) 

6.  know  how  wet\  information  read  is  understood  (-16%) 

7.  identify  relationships  between  ideas  ^  (-14%) 

8.  know  how  well  information  read  will  be  remembered  (-14%) 

9.  generate  questions  to  guide  reading  (-12%) 

10.  remember  what  was  read  a  week  later  (-10%) 

11.  summarize  the  chapter  (-09%) 

12.  complete  textbook  questions/activities  (+08%) 
'13.  change  reading  rate  to  suit  purpose  (-04%) 

14.  complete  teacher  questions/activities  (+03%) 

15.  prepare  for  exam  or  quiz  (-03%) 

16.  take  notes ^while  reading  (+01%) 

17.  take  notes  after  reading  chapter  ^(-01%) 

18.  construct  an  outline  (00%) 


ERIC 


37/ 


Texas— Part  III 


TABLE  19E 
History 

Difference  between  +inale  &  female' 


1. 

identify  important  ideas  . 

(^28%) 

2. 

take  notes  while  reading                             .  ' 

(+19«) 

3. 

construct  an  outline 

(-17%) 

4. 

interpret  diagrams,  graphs,  etc. 

(-13%) 

5. 

generate  questions  to  guide  reading 

(+12%) 

6. 

remember  what  was  read  a  day  later 

(-12%) 

7. 

complete  teacher  questions/activities 

(+11%) 

8. 

prepare  for  exam  or  quiz 

(+09%) 

9. 

know  how  well  information  read  is  understood 

(-06%) 

10. 

understand'difficult  vocabulary 

.  (-05%) 

11. 

complete  textbook  questions/activities 

(+04%) 

12. 

remember  what  was  read  a  week  later 

(-04%) 

13. 

identify  relationships -between  ideas 

(+03%) 

14. 

know  how  well  information  re'ad  will  be  remembered 

(-03%) 

15. 

take  notes  after  reading  chapter 

(+02%) 

16. 

summarize  the  chapter 

(-02%) 

17. 

concentrate  while  reading 

(+01%) 

18. 

change  reading  rate  to  suit  purpose  ■ 

(00%) 

A 


ERIC 
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8 


Texas-Part  III  TABLE  19F 


Difference  between  +H1 story  males  and  Biology  males 

1 . 

complete  textbook  questions/activities 

V  •  1  /  *  / 

z, 

Identify  Important  ideas 

J. 

unGerstanc  uitticuil  vocaDUiary 

f-14%) 

4. 

construct  an  outline  y 

^ -  1 / 

rememoer  wna^t  was  reaa  a  cay  lauer 

concentrate  while  reading 

(-¥07%) 

\  'V  /  A?  / 

7. 

interpret  diagrams t  graphs,  etc. 

8. 

take  notes  while  reading 

V -DO* / 

9. 

generate  questions  to  guide  reading 

10. 

prepare  for  exam  or  quiz 

n . 

change  reading  rate  to  suit  purpose 

12. 

remember  what  was  read  a  week-  later 

13. 

identify  relationships  between  Ideas 

14. 

take  notes  after  reading  the  chapter  ^ 

15. 

complete  teacher  question/activities 

(+03%) 

16. 

know  how  well  information  read  is  understood 

(-03%) 

17. 

know  how  well  information  read  will  be  remembered 

(-02%) 

18. 

sumnarize  the  chapter 

(-01%) 

\ 

} 


ERLC  ' 


ERIC 


Texas-Part  III  TABLE  19G 

Difference  between  +Hi story  females  &  Biology  females 


1 . 

idsnti Ty    imporLant  laead 

V  (-34%) 

2. 

understood  dlftlcuit  vocaDUiary 

(-25%) 

3. 

tdke  notes  wm le  reaaing 

(-23%) 

4. 

Qenerate  questions  to  guiac  rcauuiy 

(-19%) 

c 

D . 

prepcirc   rur   cAOiti  ui        1  lb 

(-17%) 

0  . 

AA^n^A-fM  v«a  1  a     nn  c  h  ^  nc  ho^WPPn   1  HPAS 
iQentiTy  re  latiunbii  ipa  ucwwccn  luca^ 

(-13%) 

7 

(-13%) 

o 

o. 

l/n/\w  how  wall    A  n'f  nvmii^i  nn  tpaH  1s  undSPStOOd 
Know  now  we  l  •    •  nruniiciL I  Uii  1  cau   i  a  uiiuci  uvwi. 

(-13%) 

9. 

k/\w  wall    ^  n'Fnv«ma^^  nn    v*paH  will    hp   f*PfT)@Vnb6  P6d 

Know  now  we  i  •  » riToniiciT*  i uii  i  cau  w  i  i  i  i 

(-13%) 

10. 

concentrate  wm le  reaaing 

,  (-13%) 

1  1  . 

interpret  aiagrains,  grapns,  etc. 

(-10%) 

12. 

change  reading  rate  to  suit  purpose 

(-09%) 

13. 

take  notes  after  reading  chapter 

(-08%) 

14. 

surwnarize  chapter 

(-08%) 

15. 

complete  teacher  questions/activities 

(-05%) 

16. 

construct  an  outline 

(+03%) 

17. 

remember  what  was  read  a  day  later 

(-02%) 

18. 

remember  what  was^ read  a  week  later 

1                                                      4  , 

(-01%) 

Illinois 


TABLE 


MALE 


1. 

remember  what  was  read  a  week  later 

(83.6%) 

2. 

concentrate  while  reading 

(69%) 

3. 

prepare  for  exam  or  quiz 

.  (63%) 

4. 

remember  what  was  read  a  day  later 

r 

b. 

summarize  the  chapter 

6. 

know  how  well  Information  read  will  be 
remembered. 

(60%) 

7. 

Identify  relationships  between  Ideas 

(58%) 

8.' 

Identify  Important  Ideas 

(57%) 

understana  aiTticuit  voc^Duiary 

\  ODa>  ) 

10. 

know  how  well  Information  read  1s 
understood  , 

(56%) 

11. 

self-questioning  while  reading 

(55%) 

12. 

complete  textbook  questions/activities 

(54%) 

13. 

construct  outline 

(52%) 

14. 

complete  teacher  questions/activities 

(48%) 

15. 

recall  something  to  relate  to  what  Is 
being  read 

(43%) 

16. 

change  reading  rate  to  suit  purposips 

(42%) 

17. 

notetaklng 

(37%) 

18. 

understand  diagrams , graphs ,  etc. 

(29%) 

 J         FEMALE   ' 

1.  remember  what  was  read  a  Week  later  (81.8%) 

2.  concentrate  while  redding  (77%) 

3.  Identify  Important  Ideas  '  (68%) 

4.  know  how  wel 1  Infonratlon  read  will  be 
remembered  (63%) 

5.  summarize  th^  chapter  (61%)  y 

^  6.    know  how  well  Information  riead  Is 

understood  (60%) 

7.    understand  difficult  vocabulary  (59%) 

*8.    recall  something  to  relate  to  what  Is 

being  read  .  (^%)  . 

9.    prepare  for  ^xarfl  or  quiz  (58%) 

10.  Identify  Important  ideas  (56%) 

11.  remember  what  was  read  a  day  later  (56%)    -  - 

12.  construct  an  outline  '  (55%) 

13.  self-questlorring  while  reading        \  (48%)  . 

14.  complete  te)^tbook  questions/activities"  (46%) 

15.  complete  teacher  questions/activities  (43%). 

16.  change  reading  rate  to  suit  purpose  (39%) 

17.  understand  diagrams,  graphs,  etc.  (.33%) 
19.    notetaklng  (27%) 

^  \   ■ 


nUnois  TABLE  20B 

Difference  between  +inale  S  female 

1.  recall  sometliing  to  relate  to  what  is  being' read 

2.  identify  relationships  between  ideas 

3/  notetaking  ^ 

4.  concentrate  while  reading 

5.  complete  textbook  questions/activities 

6.  self-questioning  while  reading. 

7.  .  remember  what  was  read  a  day 'later 

8.  complete  teacher  questions/activities 

9.  prepare  for  exam  or  quiz 

10.  understand  diagrams,  graphs,  etc. 

11.  know  how  well  information  read  is  understood 

12.  understand  difficult  vocabulary 

13.  construct  an  outline 

14.  change  reading  rate  to  suit  purpose 

15.  know  how  well  information  read  will  be  "remembered 

16.  remember  whdt  was  read  a  week  later 

17.  identify  important  ideas 

18.  sunmarize  the  chapter 


(-15U-- 
(-10X) 

(+1M)  ■ 

(-08*), 

(+08X) 

(+07%) 

(+061) 

(+05«)  • 

(+05%) 

(-04%) 

(-04%) 

(-033^) 

(-035)^ 

(+03%) 

(-03%) 

(+01.8%;) 

(+01%) 

(00%)  ' 


6  . 


ERIC 


TABLE  20C 


Que  5  t  i  on 


Mean 


M 


Standard 
Deviat  ion 

M  F 


never 
difficult 


hardly 
ever 
di  ff icul t 


some t  imes 
di  ff icul t 


very 
difficult 


M 

F 

F  ' 

M 

F 

M 

F 

.08 
(13) 

.08 
(IM 

.35 
(57) 

.36 
(65) 

.51 
(85) 

1  ■  -  i 

1  .'♦9 
(90) 

.06 
(10) 

.07 
(13) 

.07 
(12) 

.03 
(6) 

.35 
(57) 

.29 
(53) 

.'♦.5 
(73) 

.55 
(100) 

.13 

(22 ) 

.13 
(23)/ 

.22  . 
(36) 

.12 
(22) 

.22 
(37) 

.29 
(53) 

'.'♦3 
(71) 

(81) 

.13 
(21) 

Mi* 
(26) 

.36 
(60) 

•  30 

.35 
(57) 

.37 

.(6.8) 

.22 
(36) 

.26 
('♦8) 

-.07 
(12) 

.oi 

(12) 

.12 
(20) 

(26) 

.36 

(59) 

.31 

(56) 

(66) 

.'♦3 

(78) 

.12 
(20) 

.12 
(21) 

.26 
('♦3)  , 

.39 
(71) 

.37 
(61) 

(62) 

.25 

.19 
(3M 

.12 

(20) 

.08 
(iM 

(23) 

.  10 
(19) 

.25 
('♦2) 

.29 
(52) 

M 
(7M 

.'.3 
(77) 

.16 

(26)  / 

■.18 
(33) 

.12 
(20) 

.19 
(3M 

.33 
(5M 

.33 
(60) 

(67) 

•35 
(63) 

/ 

(23) 

.13 
(2M 

1.  Identify  important  ideas  in 
the  chapter 

2.  Identify  how  important  ideas 
are  related 

3.  Understand  difficult  words 


2.5576  2.$60'» 
2.6i»02  2.7692 
2.'»667  2.6099 


Understand  diagrams,  graphs,  2.0000  2.0989 
etc. 

.5.  Outline  the  information   in  2.52  12  2.5193 

the  chapter 

6.  Take  notes   from  what  you  read     2.2303  1.9503 
in  the  chapter 

7.  Summarize  the  chapter  in  your     2.62'»2,  2.6851 
own  words 


8.   Think  of  questions  to  ask 
yourself  5bout  what  you 
are  reading 


2.5671,,'  2.i»25'» 


9.   Recall   something  you  already      2.3636  2.5879 
know  that  v-vil  l   relate  to  what 
you  are  reading  ^ 


.7271  .7390 

.8056  .706'* 

.972'»  .8773 
.9370  .  .90'»9 

.8596  .8793 

.9730  .9'»'»'» 

.9130  .8915 

.8801  .9'*  35 


,8909      .898i»    .18      .\^      .39,  .28 
(29)    (25)    (6M  (51) 


33  1 

(55)  (80) 


.10/  .I** 
(17)  (26) 


^  TABLE  20C  (continued) 


Quest  ion 


Mean 


10.  Answer  the  questions  or 
complete  the  activities 
included  in  the  chapter 

11.  Answer  the  questions  or 
complete  the  activities 
the  teacher  has  provided 

12.  Change  your  reading  rate 
(skimming,  previewing , 
reading  slowly)  with  your 
purpose  for  reading  and  type 
of  material  you  are  reading 

13.  Prepare  for  an  exam  or  quiz 


\k.  Know  how  well  you  have  either 

understood  or  misunderstood 

what  you  have  read 

15.  Know  how  well  you  wi 1 1  be 
able  to  remember  what  you 
nave  read 

l6'.  Remember  what  you  have  read 
a  day  1  ater, 


M 


Standard 
^     Devi  at  ion 

M  F 


never 
difficult 


hardly 
ever 
difficult 


somet  imes 
difficult 


very 
difficult 


2.^788    2.3901  .8307 


2.^242    2.3370  .7821 


2.3333    2.2597      .9585  .865^ 


2.739^  2.60M  .9621 

2.539^  2.582^  .84^6 

2.739'^  2.71^3  .7301 

2.7030  2.6V8^  .8^*99 


.8780 


M 

F 

M 

F 

M 

F 

M 

F 

(23) 

.13 
(2M 

32 

(53) 

.^41 

(75) 

.^46 

(76) 

.39 
(71) 

.08 
(13) 

.07 
(12) 

.11* 
(19) 

.  12 
(22) 

.Ml 

(68). 

1  r 

.'♦5 
(81) 

J.  1 

(67) 

J.  A 

(73) 

.  07  ■ 
(11) 

A  O 

.03 
(5) 

.22 
(36)- 

r 

.21 
(37) 

.36 
(59) 

.^40 

(73) 

.29 
('♦9) 

.32 
(58) 

.13 
(21) 

.07 
(13) 

.13 
(21) 

.12 
(22) 

.2^4 

.30 
(5M 

.39 
(65) 

(80) 

.2^4 

(39) 

.1^4 

(26) 

.13 
(21) 

.12 
(21) 

.31 
(51) 

.28 
(51) 

.^6 
(76) 

51 

(^3) 

.10 
(17) 

.09 
(17) 

.01* 
(6) 

.09 
(16) 

.36 
(59) 

.28 
(50) 

.'♦3 
(72) 

.'»7 

m 

.17 
(28) 

.16 

(30) 

.08 
(IM 

.07 
(13) 

.30 

.37 
(66) 

.'♦5 
(7M 

(75) 

.17 
(28) 

.15 
(28) 

TABLE  20G  (continued) 


1  2 


X  n  LA  Standard  never  ardly.,       sometimes  very 

^  Question  Mean  Deviation  difficult      jj^^J^^^      difficult  difficult 


< 

M 

F 

M  ' 

F 

M 

F 

M 

F 

M 

F 

M 

•  F- 

17. 

Remember  what  you  have  read 

3.2667 

3.2308 

.7'*19 

.7518 

.006 

.006 

.158 

.176 

.koo 

.1»0I 

.l»36 

.M7 

a  week  later 

(1) 

(1) 

(26) 

(32) 

(66) 

(73) 

(72) 

(76) 

18. 

Concentrate  as  you  read  the 

2.8909 

2.9835 

.8973 

.8107 

,08 

.06 

.23 

.17 

.i«2 

.51 

.27 

.26 

chapter 

(13) 

(10) 

(37) 

(31) 

(70) 

(93) 

('*5) 

('♦8) 

ERIC 
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mtnois— Part  III         TABLE  200 

Biology 

Difference  between  +males  &  females 


1 

1  • 

IHontlfv  rplatlonshlDS  between  1dedS 

(-12%) 

9 

(-10%) 

-J 

O  • 

notctaKing 

(+09%) 

4 

recall  somethlnq  to  relate  to  what  is  being  read 

(-08%) 

c 

D  • 

iinHorct;)nH  Hi'f'flrijit  \/orabij1arv 

(-07%) 

C 
D  • 

rnmnTotP  tparhpr  QUPStl ons/acti vi ti eS 

(+07%) 

7 

romolptp  tpxtbook  Questions/activities 

(+06%) 

0* 

i^nnw  hnw  wall  InfnriTiAtlon  rpdd  1s  understood 

(+04%) 

0 

iinHov*ct;)fiH  HI  orains    aranhs    ptc . 

(-03%) 

in 

rnnQ^vur^  an  nu^llnp 

(+03%) 

1 1 . 

prepare  tor  exam  or  quiz 

(+03%) 

12. 

identify  important  ideas 

(-02%). 

li. 

summarize  the  chapter 

(+02%) 

14. 

self-questioning  while  reading 

(+02%) 

15. 

change  reading  rate  to  suit  purpose 

(+02%) 

16. 

know  how  well  information  read  will  be  remembered 

(r02%) 

17. 

remember  what  was  read  a  day  later 

(-01%) 

18. 

remember  what  was  read  a  week  later 

(-01%) 

ERIC 


i 


Illinois— Part  III  TABLE  20E 

History 

Difference  between  +inales  &  females 


1. 

recall  something  to  relate  to  what  Is  being  read 

(-19%) 

2. 

notetaking 

(+12%) 

3. 

complete  textbook  questions/activities 

(-12%) 

4. 

self-questioning  while  reading 

(+10%) 

5. 

know  how  well  Information  read  Is  understood 

(-09%) 

6. 

Identify  relationships  between  Ideas 

(-08%) 

7. 

prepare  for  exam  or  quiz 

(+08%) 

8. 

remember  what  was  read  a  day  later 

(+07%) 

9. 

concentrate  while  reading 

■ (-07%) 

10. 

change  reading  rate  to  suit  purpose 

(+06%) 

11. 

construct  an  outline 

(-05%) 

12. 

remember  wh,»t  was  read  a  week  later 

(+05%) 

13. 

Identify  Important  Ideas 

(+04%) 

14. 

understand  diagrams,  graphs,  etc. 

(-04%) 

15. 

know  how  well  Information  read  will  be  remembered 

■  (+04%) 

16. 

understand  difficult  vocabulary 

(+03%) 

17. 

complete  teacher  questions/activities 

(+03%) 

18. 

summarize  the  chapter  , 

(-01%) 

\ 


-Illinois— Part  III  TABLE  20F 

Difference  between  +Hi story  males  &  Biology  males 


1 

nrPDarp  for  exam  or  Quiz 

(-18%) 

L  • 

iinripr^tand  difficult  vocabulary 

(-11%) 

O  • 

rnmniptp  tpxthook  Questlons/actl v1 tIes 

A 

• 

recall  somethlnq  to  relate  to  what  Is  being  read 

(-10%) 

C 

w  • 

rhanop  readlno  rate  to  suit  DurDOse 

(-10%) 

c 
0  • 

/*nnc ^y*ii/*^  an  niitllnp 

(-09%) 

7 

rnmnlptp  tparlier  ouestlons/actl v1  tIes 

(-09%) 

o 
o  • 

understand  diagrams,  graphs,  etc. 

(-08%) 

Q 

i^nnui  hnw  wpI  1  Information  read  Is  understood 

(-07%) 

lO. 

sumniarize  une  cnapt&r 

(-06%) 

1  1 
1  1  • 

1Hont*ifv  Imnnrfant  Ideas 

(+05%) 

12. 

remember  what  was  read  a  day  later 

(+04%) 

13. 

concentrate  while  reading 

(+04%) 

14. 

self -questioning  while  reading 
Identify  relationships  between  Ideas 

(+03%) 

15. 

(=02%) 

16. 

know  how  well  Information  read  will  be  remembered 

(-01%) 

17. 

notetaking 

(00%) 

18. 

remember  what  was  read  a  week  later 

(00%) 

^ — ' 
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Illinois— Part  III         TABLE  2Q6 

Difference  between  +H1story  (females  &  Biology  females 


1. 

prepare  for  exam  or  quiz 

(-23%) 

2. 

understand  difficult  vocabulary 

(-21%) 

3. 

complete  textbook  questions/activities 

(-17%) 

4. 

change  reading  rate  to  suit  purpose 

(-14%) 

5. 

understand  diagrams,  graphs,  etc. 

(-07%) 

6. 

Identify  relationships  between  Ideas 

(-06%) 

7. 

know  how  well  Information  read  Is  understood 

(+06%) 

8. 

remember  what  was  'read  a  week  later 

(-06%) 

9. 

self-questioning  while  reading 

(-05%) 

10. 

complete  teacher  questions/activities 

(-05%) 

11. 

notetaking 

(-04%) 

12. 

sunmarlze  the  chapter 

(-03%) 

13. 

remember  what  was  read  a  day  later 

(-02%) 

14. 

Identify  Important  Ideas 

(-01%) 

15. 

construct  an  outline 

(-01%) 

16. 

recall  something  to  relate  to  what  Is  being  read 

(+01%) 

17. 

know  how  well  Information  read  will  be  remembered 

(+fl%) 

18. 

concentrate  while  reading 

(+01%) 

ERIC 


Illinois  TABLE  21A 

1  .^yldentlfy  which  Idea^  should  be  remembered  (97.4%) 

2.  review  chapter  before  exam  "  (96.2%) 

3.  relate  new  Ideas  to  Idea^students  already  know  (93%) 

,  4.    teach  students  to  IdentifyTirtportant  iSeas  ^     (92%)  " 

5.  teach  students  €b  Identify  relationships  between  ideas  (90%) 

6.  provide  questions  to  guide  student *s  reading  (88%) 

7.  explain  difficult  vocabula/y  (86%)  , 

8.  use  textbook  which  Is  more  Interesting  to  read  (82%) 

9.  provide  students  with  time  In  class  to  Y'ead  (81%) 

10.  discuss  Information  not  covered  In  chapter  (81%) 

11.  provide  an  outline  or  overview  of  chapter  (81%) 

12.  provide  students  with  time  In  class  to  get  together  and 

discuss  Ideas  ,  (76%) 

13.  use  a  textbook  which  Is  more  up-to-date  (71%) 

^       14.    spend  more  time  explaining  the)  chaptc(r  before  students  read 

^              It      .                  ^                /  (69%) 

15.  assign  additional  activities  ^rfch  wll  1  help  students 
unders^d  new  Ideas      ""^/^  (66%) 

16.  provide  additional  material  to  read  .  (54%) 

17.  use  textbook  which  Is^-easler  to  read  ^  (49%) 

18.  spend  time  teaching  study  skills  (47%) 

19.  allow  students  to  read  textbook  on  their  own  rather  than 

making  reading  assignments  (40%) 

20.  spend  time  teaching  reading  skills  (39%) 

21.  cease  using  the  textbook  (16%) 


ERIC 


TABLE  21 B 


Standard  \ 
Deviation  \ 

\ 

1 

1  . 

I 

i 

il 

Question     '  - 

Mean 

.Strongly 
disagree 

di  sagree 

agree 

Strongly 
agree 

1 . 

Spend  more  time  explaining 
the  chapter  before   1  read 
It 

2.8150 

\ 

'.  -7730 

.05  . 
KM) 

.26 
190) 

.52 

lou; 

2. 

Go  over  the  chapter  jn  class 
before  "a  test 

3.673A 

.561.9 

.006 

\l) 

.  .'032 
U  ! ) 

.2^*6 
|ob) 

,716 
UHo) 

3. 

Tell  me  which  ideas  in  the 
Chapter  1  should  remember 

3.661.7 

>  5^*67 

.006 

\l) 

.020  . 
\l) 

^'^  .277 

.697 

\IH\  } 

li. 

Explain  how  new  ideas  are 
related  to  things   1  already  « 
knov/ 

3.3382 

.6312 

.01 

13) 

.06 
121) 

.51 

.1»2 

5 . 

Explain  the  difficult  words 
in  the  chapter 

3. lolo 

.o95o 

(6) 

(1»2) 

'  5^ 
(188) 

.  J*/ 

(no) 

6. 

Discuss  Information  which, 
the  chapter  has  hot  covered 

3.  ll»20 

.8281. 

.01* 
(15) 

.15 
(52) 

.i»3 

'  (li»7) 

.38 
(131 ) 

1. 

Provide  me  an  overview  or 
outline  of  the  chapter 

3.0838 

.7235 

.01 

(5) 

.18 
.  (62) 

.52 
(178) 

.29, 
(101) 

8. 

Provide  questions  to  guide 
my  reading  of  the  chapter 

3.1556 

.6923 

(8) 

.10 

(36) 

.57 
(196) 

.31 

(105) 

o         395  '  ■         ■ •  ■     '  -  395 
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TABLE  21 B  (continued) 


V 


Quest  Ion 


\ 


Mean 


Standard 
Oeviat  ion 


1 


s  trong ly 
di  sagree 


disagree 


agree 


s  trong ly 
agree 


9.  Provide^  add  i  tiona  I  material 
CO  read  (handouts,  books, 
etc. ) 


\ 


me  time  in  class  to  read 


10,  G  i 

the  ti 

I  I  .  Let  me  read  the  text  for 
nyself  instead  of\making 
readi  ng  ass  ignment; 

12.  Give  students  time  iVi  class 
to  get  together  and  aiscuss 
the   ideas   in  the  text 

13-  Assign  additional  activities 
to  help  me^unde rs tand  the 
ideas  in  the  chapter 

1^.  Teach  me  how  to  find  out  , 
which  ideas  in  the  chapter 
are  important 

15.  Teach  me  how  to  find  out 

whether  one  important  idea^ 
is  related  to  another 


2.5983 

3. 0838 
2.3881* 

2.9827 
2.7370 
3.3256 
3.181»1» 


.8007 

.7663 
.8626 

.8269 
.8077 
.6500 
.632b 


.07 
(2M 


.03 
(11) 

.13 

('«5) 


.05 
(18) 


.07 
(25) 


.01 

■  (3) 


.01 

(M 


.39 
(136) 


.16 

(55) 

(163) 


.19 

(67) 


.27 
(95) 


.07 
(26) 


.09 
(31) 


.ill 


.50 

(17M 


18 


(9 


.1*8 
(161.) 


.50 
(172) 


.50 
(173) 


.60 
(209) 


.13 
(i»5) 

/   '  ■ 

.31 
(106) 

.12 
(1»2) 


.28 
(97) 


AS 
(5M 


.1»2 

(l'«5) 


.30 
(103) 


ERJG 
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TABLE  21B" (continued) 


Quest  Ion 

Mean  ^ 

f  Standard 

1 

2 

3 

k 

jDeviation 

/ 

3  1. 1  Oil  y  1  Y 
dl  sagree 

d  i  sagree 

agree 

s  t  rong 1 y 
agree 

1  0  . 

Spend  time  teaching  reading 
skills  (skimming,  previewing) 

2.3256 

.8157 

.  I** 
('♦9) 

.'♦7 
(I6M 

.31 
(106) 

.08 
(28) 

1  7 

Spend  time  teaching  study 
skills   (notetaking,  out  1  iii  i  ng  ,.- 
summari2ing) 

2.^595 

.13 
('♦5) 

.ko 
(138) 

.35 
(122) 

.12 
(M) 

18. 

Use  a  texcbook  which  is 
easier  to  read 

.8231 

.08 
(28) 

.'•3 

.36 

(125) 

.13 
('46) 

19. 

Use  a  textbook  which  is  more 
interesting  to  read 

3.2225 

.7836 

.02 

(7) 

.16 

(55) 

(138) 

.kl  . 
(I'«6) 

20. 

Use  a  textbook  which  Is  more 
up- to-date 

3.0029 

.8392 

.03 
(II) 

.26 
(88) 

.39 
(136) 

.32 
(III) 

21  , 

Not  use  the  textbook  at  al  1 

1 .8000 

.  8780 

.'♦3 
(l**^)' 

.k\ 
(I'^l) 

\09 
(30) 

.07 
(25) 

ERIC 
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Illinois  '    TABLE  22A  \ 

Biology 

1.  review  chapter  before  exam  (98%) 

2.  identify  which  ideas  should  be  remembered  (97.9%) 

3.  relate  new  ideas  to  ideas  students  already  know  (93%) 

4.  explain  difficult  vocabulary  (90%) 

5.  teach  students  to  identify  important  ideas  (90%) 

6.  teach  students  to  identify  relationships  between  ideas  (87%) 

7.  discuss  information  not  covered  in  the  chapter  (86%) 

8.  use  textbook  which  is  more  interesting  to  read  (84%) 

9.  provide  questions  to  guide  student's  reading  (84%) 

10.  provide  an  outline  to  overview  of  chapter  (77%) 

11.  assign  additional  activities  which  will  help  students 
understand  new  ideas  *  (77%) 

12.  provide  students  with  time  in  class  to  read    ,  (76%) 

13.  use  a  textbook  which  is  more  up-to-date  (76%) 

14.  spend  more  time  explaining  the  chapter  before  students 

read  it  (73%) 

15.  provide  students  with  time  in  class  to  get  together  and 
discuss  ideas  .  (71%) 

16.  provide  additional  material  to  read  '  (58%) 

17.  use  a  textbook  which  is  easier  to  read  (49%) 

18.  spend  time  teaching  study  skills  "  (46%) 

19.  spend  time  teaching  reading^skills  (37%) 

20.  allow  students  to  read  textbook  on  their  own  rather  than 
making  reading  assignments  (25%) 

21.  cease  using  the  textbook  (12%) 


History 


ERLC 


1.  identify  which  ideas  should  be  rememb/ered  (97%) 

2.  review  chapter  before  exam  /  (95%) 

3.  relate  new  ideas  to  ideas  stu^dei^ts^al ready  know  (93%) 

4.  teach  students  to  identify  important  ideas  (93%) 

5.  teach  students  to  identify  relationships  between  ideas  (91%) 

6.  provide  questions  to  guide  student's  reading  -  (90%) 

7.  provide  students  with  time  in  class  to  read  (85%) 


401  ' 


Illinois  TABLE  22A  (continued) 

History 


8. 

explain  difficult  vocabulary 

(84%) 

9. 

provide  an  overview  or  outline  of  chapter 

(83%) 

use  textbook  which  is  more  interesting  to  read 

(81%) 

11. 

provide  students  with  time  in  class  to  get  together  and 
discuss  ideas 

(79%) 

12. 

discuss  information  not  covered  in  chapter 

(78%) 

13. 

use  a  textbook  whi'^h  is  more  up-to-date 

(68%) 

1  A 

14. 

spend  more  time  explaining  the  chapter  oetore  stuaents 
read  it 

(66%) 

15. 

assign  additional  activities  whi<;h  will  help  students 
understand  new  ideas 

(57%) 

16. 

provide  additional  material  to  read 

(51%) 

17. 

allow  students  to  read  textbook  on  their  own  rather  than 
making  reading  assignments 

(50%) 

18. 

use  textbook  which  is  easier  to  read 

*7(50%) 

19. 

spend  time  teaching  study  skills 

(48%) 

20. 

spend  time  teaching  reading  skil Is 

(40%) 

21. 

cease  using  the  textbook 

V 

«  V 


ERIC 
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Illinois  TABLE  22B 

Difference  between  Biology  &  +Hi story 

1.  allow  students  to  read  the  textbook  on  their  own  rather 

than  making  reading  assignments  (+25%) 

2.  assign  additional  activities  which  will  help  students  - 
understand  new  ideas  .  (-20%) 

3.  provide  students  with  time  in  class  to  read  (+09%) 

4.  provide  students  with  time  in  class  to  get  together  and 
discuss  ideas  (+08%) 

5.  dilcuss  information  not  covered  in  the  chapter  (-08%) 

6.  use  a  textbook  which  is  more  up-to-date  (-08%) 

7.  spend  more  time  explaining  the  chapter  before  students 

read  it  (-07%) 

:8.    provide  additional  material  to  read  (-07%) 

9.    cease  using  the  textbook  (+07%) 

10.  explain  difficult  vocabulary        ^  (-06%) 

11.  provide  an  overview  or  outline  of  the  chapter  (+06%) 

12.  provide  questions  to  guide  student's  reading  (+06%) 

13.  teach  students  to  identify  relationships  between  ideas  (+04%) 

14.  review  chapter  before  exam  (-03%) 

15.  teach  students  to  identify  important  ideas J.  (+03^) 

16.  spend  time  teaching  reading  skills  (+03%) 

17.  use  a  textbook  which  is  more  interesting  to  read  (-03%) 

18.  spend  time  teaching  study  skills  (+02%) 

19.  use  a  textbook  which  is  easier  to  read  (+01%) 

20.  identify  which  ideas  should" be  remembered  (-00.9%) 

21.  relate  new  ideas  to  ideas  students  already  know  (00%) 


ERIC 
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TABLE  22C 


1 

2 

3 

 4- 

5 

* 

Quest  ion 

Mean 

Standard 
Oeviat  ion 

strongly 
disagree 

°  disag 

ree 

agree 

strongly 
agree 

B 

M 

B 

M 

B 

M 

B 

H 

B 

M 

B 

H 

1 . 

Spend  more  time  explaining 
the  chapter  before  1  read 
it 

2. 

8671 

2 

7783 

.7713 

.77^0 

.05 
(7) 

.05 
(10) 

.22 

(32) 

.29 

(58) 

(77) 

.50 
(102) 

.19 

\27) 

.16 

(33) 

2. 

Go  over  the  chapter  in  class 
before  a  test 

3 

7^13 

3 

6256 

.^4852 

.6116 

.00 

(0) 

.01 

(2) 

.02 

(3) 

(8) 

.22 

(31) 

.27 

(5M 

.76 
(109) 

.68 
(139) 

3. 

Tell  me  which  ideas  in  the 
Chapter   1  should  remember 

^3.6993 

3 

em 

.5312 

.5573 

.007 
(1) 

.005 
(1) 

.01  A 

(2) 

.025 

(5) 

.252 
(36) 

.295 
(60) 

.727 
(lOM 

.675 
(137) 

k. 

Explain  how  new  ideas  are 
related  to  things   1  already 
know 

3 

.3706 

> 

3 

■  3153 

.G2kh 

.636^4 

.01 

( 1  i 

.01 

.06 

(8) 

.06 
(13) 

.'•^3 

.53 

(107) 

.kk 

(63) 

.ko 

(81 ) 

5- 

Explain  the  difficult  words 
in  the  chapter. 

3 

2028 

3 

.  1  330 

.6772 

.7085 

L 

t 

.02 
(3) 

• 

.01 

(3) 

.08 

(12) 

.  1  5 
(30) 

.57 
(81) 

.53 
(107) 

.33 

.31 
(63) 

6. 

Discuss   i nforma t i on  wh i ch 
the  chapter  has  not  covered 

3 

2797 

3 

OkiiG 

.7^50 

.8713 

.01 

(2) 

.06 
(13) 

.13 
(19) 

.16 

(33) 

.k2 
(59) 

.kk 
(88) 

(63) 

(68) 

7. 

Provide  me  an  overview  or 
outline  of  the  chapter 

3 

0000.,^, 

3 

.72k^ 

.7188 

.01 

(2) 

.02 

(3) 

.22 
(31) 

.15 
(31) 

.52 
(7M 

.51 
{\0k) 

.25 
(35) 

.32 
(66) 

Provide  questions  to  guide 
my  reading  of  the  chapter 

3 

.007  \ 

3 

25^3 

.7121 

.6612 

.Ok 
(6) 

.01 
(2) 

.12 

(17) 

.09 
(19) 

.63 

(88) 

.53 
(108) 

.21 
(30) 

.37 
(75) 
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TABLE  22C  (continued) 


\ 


1 


Question 


Mean 


Standard 
Devi  at  ion 


s  trongly 
d! sagree 


di  sagree 


agree 


s  trongly 
agree 


B 

H 

B 

H 

B 

H 

B 

H 

B 

B 

B 

H 

.  9. 

Provide  additional  material 
to  read  (handoijts,  books, 

2.6'*  79 

2.5637 

.7551 

.83)0 

.05 

(7)' 

.08 
(17) 

.37 
(53) 

(83) 

.i46 

(65) 

.37 
(76) 

.12 

(17) 

(28) 

etc .  ) 

10. 

Give  me  time  in  class  to  re^ 
the  text 

2 

3.  1667 

.7'*W 

.7699 

.03 

.03 
(7) 

.21 

(30) 

.12 

(25) 

.53 

(75) 

(99) 

.23 
(33) 

.36 
(73) 

1 1 . 

Let  me  read  the  text  for  " 
myself  instead  of  rfiaking 
reading  assignments 

2. 

1 197 

2.576'^ 

.79'*3 

.8605 

.20 
(28) 

.08 
(17) 

.55 
(78) 

(85) 

.19 

(27) 

(68) 

.06 

(9) 

.16 

(33) 

12. 

Give  students  time  in  class 
to  get  together  and  discuss 
the  ideas   in  the  text 

2 

8169- 

3.0980 

.7956 

.8306  ' 

.06 

(9) 

(9) 

.23 

(33) 

.17 
(3M 

.53 
(75) 

(89) 

.  18 

(25) 

.35 

(72) 

13. 

Assign  additional  activities 
to  help  me  understand  the 
ideas   in  the  chapter 

2 

.9155 

2  .6127 

.7579 

.8197 

.iD5 
(7) 

.09 
(18) 

.18 
(26) 

(69) 

.57 
(81) 

(91) 

» 

.20 

(28) 

.13 
(26) 

Teach  me  how. to  find  out 
which  ideas  in  the  chapter 
are  important  ^ 

3 

3357 

3.^)86 

.6520 

.00 
(0) 

.01 

(3) 

r 

.  10 
(I'*) 

.06 
(12) 

(67) 

J. 

.52 
(106) 

.'*3 
(62) 

.M 
(83) 

15. 

Teach  me  how  to  find  out 
whether  one  important  idea 
is  related  to  another 

3 

.1538 

3.2059 

.6252 

.O'l 

(1) 

.02 

(3) 

.  12 

(17) 

.07 
(IM 

.59 

m 

■  .61 
(125) 

.28 

.30 
(62) 
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TABLE  22C  (continued) 


I 


3 


Quest  ion 


Mean 


Standard 
Deviation 


strongly 
dl sagree 


disagree 


agree 


s trdngly 
agree 


. 

B 

H 

B 

H 

B 

H 

B 

H 

B 

^  H 

B, 

H 

16. 

Spend  time  teaching  reading. 
si<ills   (skimming,  previewing) 

2.2867 

2. 

3529 

.8103 

.8203 

.15 

(22) 

.13 

(27) 

.48 
(68) 

■.47 
(96) 

■A 

.30 

(43) 

.31 

\(63) 

.07 
(10) 

.09 
(18) 

17. 

■  '  / 
Spend  time  teaching  study 
skills   (notetaking,  outlining, 
summari  zi  ng) 

2.^4266 

2t 

i»828 

.8998 

.8405 

.15 

(22) 

.11 

(23) 

.39 
(56) 

.41 

•  (82.) 

.33 
(47) 

.37 
(75) 

.13 

(18) 

.11 

(23) 

18. 

Use  a. textbook  which  is 
easier  to  read 

l.ShSS 

2. 

5^*68 

.8025 

.8393 

.07 
(10) 

.09 
(18) 

.44 
(63) 

.41 

(94) 

.36 
(52) 

.36 
(73). 

.13 

(18) 

.14 
(28) 

19. 

Use  a  textbook  which  is  more 
interesting  to  read 

3.2378 

3. 

21  18 

.7502 

.  8080 

.01 

(2) 

.02 
(5) 

.15 

(21) 

.17 
(34) 

.43  . 
(61) 

.38 

(77). 

,1.. 

.41 

(59) 

.^3  . 
(87) 

20. 

Use  a  textbook  which  is  more 
up-to-date 

3.0769 

2". 

9507 

•7968 

V 

.8660 

.02 

(3)  . 

.04 

(8) 

.22 
(31) 

.28 
(57) 

.43 
(61) 

.37  -^33 
(75)^8) 

.31 

(63) 

21  . 

Not  use  the  textbook  at  al 1 

1 .6993 

1  . 

8713 

.-8561 

.8884 

.49 

(70) 

.39 

(79) 

,39 
(56) 

.42 

(85) 

.05 
(7) 

.12 
■(23) 

.07 
(10) 

'.07 
(15) 
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Illinois            V.             TABLE  23A 

1. 

Male 

identify  which  ideas  should  be  remembered 

(95%) 

2. 

review  chapter  before  exam 

(94%) 

3. 

relate  new  ideas  to  ideas  students  already  know 

(92%). 

4. 

teach  students  to  identify  important  ideas 

(92%) 

■5. 

teach  students  to  identify  relationships  between  ideas 

(90%) 

6. 

use  textb'ook  which  is  more  interesting  to  read 

(84%^ 

7. 

explain  difficult  vocabulary 

(83% J'  • 

8. 

discuss  information  not  covered  in  the  chapter 

(•83%) 

n 
9  . 

provi oe  to      ' s tuaen ts    reau i nyb  v* 

(81%) 

1  A 

10. 

provide  students  witn  time  in  ciass  to^ redu 

\  OU/o  / 

11  . 

provide  an  outline  or  overview  of  the  chapter 

12. 

provide  students  with  time  in  class  to  get  together  and 
discuss  ideas  , 

\  /Oh ) 

13. 

use  a  textbook  which  is  more  up-to-date 

(71%) 

14. 

spend  more  time  explaining  the  chapter  before  students  read 
It 

(68%) 

lb . 

r^eeArt^   aHHT+innal    ar^ix/i^iPC  wh  "i  rh  wi  1  1    hcl  D    S  t  Udent  S 
assign  aOQltionpl    aLtivitiCo  wnii-ii  will   Mcijj  J  i^uu^ii  \i>  J 

understand  riew  ideas 

(59%) 

Id  . 

provi  oe  aaaitiunal  inatcriai    cu  1  cau 

(52%) 

17. 

use  a  texuDOOK  wnicn  is  easier  tu  rcau 

\>J  I  /o  f 

18. 

spend  time  teac^ing  study  skills 

19. 

allow  students  to  read  textbook  on  their  own  rather  than 
making  reading  assignments 

(43%) 

20. 

spend  time  teacning  reading  ski  i  is 

21 . 

csase  using  tne  teAtDooK 

-V  Female 

\  \o/o  } 

1. 

identify  which  ideas  should  be  remembered 

(99%) 

2. 

review  chapter  before  exam 

(99%) 

3. 

relate  new  ideas  to  ideas  students  already  know 

(94%) 

4. 

provide  questions  to  guide  students'  reading 

(93%) 

5. 

teach  students  to  identify  important  ideas 

(92%) 

6. 

teach  students  to  identify  relationships  between  ideas 

(90%) 

7. 

explain  difficult  vocabulary 

(89%) 

er|c  ^^t) 


TABLE  2 3A  (continued) 

8.  provide  an  overview  or  outtine  of  the^chapter  (82%) 

9.  '  provide  students  with  time  in  class  to  read  (82%) 
10.  use  a  textbook  which  is  more  interesting  to  read  (80%) 
11:    discuss  information  not  covered  in  the  chapter  (78%) 

12.  •  provide  students  with  time  in  class  to  get  together  and 

discuss  ideas  (75%) 

13.  assign  additional  activities  which  will  help  students 
understand  new  ideas  (72%) 

14.  use  a  textbook  which  is  more  up-to-date  '  (71%) 

15.  spend  more  time  explaining  the  chapter  before  students  read 

it  (70%) 

16.  n^ovide  additional  material  to  read  (56%) 

17.  use  a  textbook  which  is  easier  to  read  ,  ^  (48%) 

18.  spend  time  teaching  study  skills  (47%) 

19.  spend  time  teaching  reading  skills  '  (39%) 

20.  allow  students  to  read  textbook  on  their  own  rather  than  ^ 
making  reading  assignments  (37%) 

21.  cease  using  the  textbook  (14%) 

.f- — 
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Illinois  '  TABLE  23B 

  Difference  between  +male  &  female 

1.  assign  additional  activities  which  will  help  students 
understanifnew  Ideas  (-13%) 

2.  provide  questions  to  guide  students*  reading  (-12%) 

3.  explain  difficult  vocabulary  <  ("96%) 

4.  allow  students  to  read  textbook  on  their  own  rather  than 

making  reading  assignments.  (+06%) 

5.  review  chapter  before  exam                        "  (-05%) 

6.  discuss.  Information  not  covered  In  the  chapter  (+05%) 

7.  Ideff^lVy  which  Ideas  should  be  remembered  ^  (-04%) 

8.  provide  additional  material  to  read  (-04%) 

9.  use  a  textbook  which  Is  mor^  Interesting  to  read  (-04%) 

10.  cease  using  the  textbook  (+04%) 

11.  provide  an  overview  or  outline  of  the  chapter  (-03%) 

12.  use  a  textbook  which  Is  easier  to  read  ■ (+03%) 

13.  spend  more  time  explaining  the  chapter  before  students  read 

It                             '  (-02%) 

14.  relate  new  ideas  to  Ideas  students  already  know  (-02%) 

15.  provide  students  with  time  In  class  to  read  (-02%) 

16.  spend  time  teaching  study  skills  (+01%) 

17.  provide  students  with  time  In  class  to  get  together  and 

discuss  Ideas  (00%) 

18.  teach  students  to  Identify  Important  Ideas  (00%) 

19.  teach  students  to  Identify  relationships  between  idgas  (00%) 

20.  spend  time  teaching  reading  skills  (00%) 

21.  use  a  textbook  which  Is  more  up-to-date  '  (00%) 
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TABLE  23C 


Que  s  t  i  on 


Mean 


Standard 
Dev  i  at  i  on 


5  t  rongly 
d  i  sagree 


di  sagree 


agree 


strongly 
agree 


M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

M 

F 

1 

1  • 

fiH   mo  r  p    t  \  nrtp  p^nl^inlnn 

wk^C  1  lU     ttlKJ  1  C      LI  IIIC     C^l^'ia  ill  1  ii>^ 

the'chapter  before  1  read 
it 

2 . 

806l 

2  . 

8232 

7970 

.Ok 
(6) 

.06 
(11) 

.28 
('^7) 

.2k 

{k3) 

.52 
(85) 

.52 

Ok) 

 «- 

.16 

(27) 

.18 
(33) 

2. 

Go  over  the  chapter  in  class 
before  a  test 

.3. 

5697 

3. 

7680 

.655'* 

.of 

(2) 

.00 

(0) 

.05 
(9) 

.01 

(2) 

.29 
('^7) 

.21 

(38) 

.65 

(,107) 

.78 
(\k]) 

3. 

Tell  me  which  ideas  in  the 
chap,ter*  1  should  remember 

3 

539^ 

3. 

7790 

.6295 

.^232 

.01 

(2) 

.'00 
(0) 

.Ok 

(6) 

.01 

(1) 

.35 
(58) 

.21 

(38) 

.60 
(99) 

.78 

.{]k2) 

Explain  how  new  ideas  are 
related  to  things   1  already 
koow 

3 

2970 

3. 

3757 

.02 

(3) 

.00 

(0) 

.06 

(10) 

,06 
(II) 

.53 
(87) 

.50 

,(91) 

.39 
(65) 

.kk 
(79) 

Explain  the  difficult  words 
1 n  the  chapter 

3 

.0970 

3. 

2210 

.6916 

.6959 

.01 
(2) 

.02 

(M 

.16 

(26) 

.09 
(16) 

.55 
(91) 

.5'« 

(9^7) 

.28 

('^6) 

.35 
(6M 

6. 

Discuss   information  which 
the  chapter  has  not  covered 

3 

1818 

3- 

1056 

.798'< 

.8555 

.Ok 
(6) 

.05 

(9) 

.13 

(22) 

.17 

(30) 

.kk 

(73) 

.k\ 

{7k) 

.39 

(6M 

.37 

(67) 

7. 

Provide  me  an  overview  or 
outline  of  the  chapter 

3 

.05^*5 

3. 

1 105 

.7671 

.6823 

.03 

(5) 

.00 

(0) 

.18 

(29) 

.18 

(33) 

.50 

(83) 

.53 

(95) 

.29 

('^8) 

.29 

(53) 

8. 

Pfovlde  questions  to  guide 
my  reading  of  the  chapter 

3 

.02^42 

3. 

2722 

.7567 

.6057 

.0^4 

(7) 

.01 

(1) 

.15 

{2k) 

.06 
(12) 

.56 
(92) 

.58 
(lOM 

.25 

('^2) 

.35 

(63) 
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TABLE  23C  (continued) 


1 


3 


Quest  Ion 


Mean 


^.  Provide  additional  material 
to  read  (handouts,  book^ , 
etc.) 


2.5636  2.6298 


10. 


I  I 


12 


Give  me  time  in  class  to  read  3-1091  3.O608 
the  text 


Let  me  read  the  text  for 
myself  instead  of  making 
reading  assignments 

Give  students  time  in  class 
to  get  together  and  discuss 
the  Ideas  in  the  text 


13.  Assign  additional  activities 
to  help  me  understand  the 
ideas   in  the  chapter 

I  A.  Teach  me  how  to  find  out 
which  Ideas  In  the  chapter 
are  Important 

15.  Teach  me  how  to  find  out 
whether  one  important  idea 
is  related  to  another 


2.^788  2.3056 


3.000  2.9669 


2;606l  2.856^4 


3.2970  3.3516 


3.1636  3.2033 


Standard 
Deviation 


strongly 
disagree 

M  F 


disagree 


ag  ree 


strongly 
agree 

M  F 


,8A3I      .7608    .09      .05      .39      .39      .38  .1^  .12 

(15)     (9)      (65)     (71)     (62)     (79)     (23)  (22) 


.7316 

.0^4 

(6) 

.03 

(5) 

.16 

(27) 

.15 

(28) 

.kS 
(75) 

.55 
(99) 

.35 
(57) 

.27 
('*9) 

(21) 

(2M 

(73) 

.  ^u 

(90) 

25 

(53) 

.  1  8 
(29) 

07 
(13) 

8337 

.3226 

.05 

(8) 

.06 

(10) 

.20 
(33) 

.19 

(3M 

.k^ 

(75) 

.k3 
(89) 

.30 

(^♦9) 

.26 
('*8) 

8315 

V 

.768'4 

.  10 
(17) 

.ok 
(8) 

.31 

(51) 

.Ik ' 

{kk) 

M 
ill) 

.53 
(95) 

.12 

(20) 

,19 

6738 

.6285 

.02 

(3) 

.00 

.(0) 

.06 
(11) 

.08 

(15) 

.52 
(85) 

.^9 
(88) 

.ko 
(66) 

M 
(79) 

6653 

.6015 

.02 

(M 

.00 
(0) 

.08 
(13) 

.10 

(18). 

.61 

(100) 

.60 
(109) 

.29 
('*8) 

.30 
(55) 
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TABLE  23C  (continued) 

—  


1 


Ques  t  ion 


Mean 


Standard 
Devi  at  ion 

M  F 


Strongly 
disagree 


di  sagree 


agree 


strongly 
agree  I 


16.  Spend  time  teaching  reading        2.3152  2,3352 
skills   (skimming,  previewing) 

17.  Spend  lime  teaching  study  2.^207  2.^9^5 
skills   (notetaking,  outlining, 

summar  i  z  i  ng) 


18.  Use  a  textbook  which  is 
easier  to  read 


2.5818  2.5138 


19.  Use  a  textbook  which  is  more      3.2667  3.1823 
interesting  to  read 

20.  Use  a  textbook  which  is  more      2.9636  3.O387 
up-to-date 


21.  Not  use  the  textbook  at  all 


1.8i*05  1.7637 


.8611 
.9066 

.7577 
.7897 
.8688 
.9225 


77'* 


7781 


M 

F 

M 

F 

M 

F 

M 

F 

.16 

(27) 

.12 

(22) 

(75) 

(89) 

.29 

.32 
(59) 

.10 
(16) 

.07 
(12) 

.17 
(28) 

.09 
(17) 

.35 
(58) 

.kk 
(80) 

.36  • 

(59) 

.35 

(63) 

.12 

(19) 

.12 
(22) 

.05 

(8) 

.  1  1 

(20) 

(72) 

.VI 

(75) 

.^0 
(66) 

.33 
(59) 

.  1 1 
(19) 

.15 

(27) 

.02 

{^) 

.02 

(3) 

.]k 
(23) 

.18 

(32) 

.38 

(63) 

.k\ 
(75) 

(75) 

.39 

(71) 

.06 

(9)  ' 

.01 

(2) 

.23 

(38) 

.28 

(50) 

(68) 

.37 
(68) 

.30 
(50) 

.3^ 
(61) 

(70) 

.^3 
(79) 

.39 
(63) 

•  ^3 

(78) 

.  10 

(16) 

.08 
(IM 

.08 
(iM 

.06 
(11) 
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Illinois-Part  IV  TABLE  23D 

Biology 

'Difference  between  +males  &  females 

1.    assign  additional  activities  which  will  help  students 
understand  new  ideas 

provide  additional  material  to  read 

provide  questions  to  guide  students'  reading 

provide  students  with  time  in  class  to  get  together  and 
discuss  ideas 

explain  difficult  vocabulary  ^ 
review  chapter  before  exam 

relate  new  ideas  to  ideas  students  already  know 
provide  students  with  time  in  class  to  read 
use  textbook  which  is  easier  to  read 
identify  which  ideas  should  be  remembered 


2. 
3. 
4. 

5. 

6. 

7. 

8. 

9. 
10. 
11. 

12. 

13. 
14. 
15. 
16. 
17. 
18. 
19. 
20. 
21. 


spend  more  time  explaining  the  chapter  before  students  read 
it 

allow  students^to  read  textbook  on  their  own  rather  than 
making  reading  assignments 

^end  time  teaching  study  sWlls 

use  a  textbook  which  is  more  interesting  to  read 

discuss  information  not  covired  in  chapter 

provide  an  outline  or  overview  of  chapter 

teach  students  to  identify  relationships. between  ideas 

use  a  textbook  which  is  more  up-to-date 

cease  using  the  textbook'  |  , 

spend  time  teaching  reading  skills 

teach  students  to  identify  important  ideas 


■14%) 
■13%) 

;-n%) 
-11%) 

-07%) 
-06%) 

;-06%) 

■06%) 
:+06%) 

:-o4%) 

[+03%) 

:+o3%) 

[+03%) 
;-03%) 
-02%) 

;-oi%) 

-01%) 

■m) 
;-on) 

[00%) 

;o€%) 


( 
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nai'nois--Part  IV  TABLE  23E  y      /      -  ,  ,s 

History 

Difference  between  +niales  &  females 

1.    provide  Questions  to  guide  students'  reading  (-13%) 

2^    discuss  Information  not  covered  In  the  chapter  (+11%) 

3.  assign  additional  activities  .which  will  heTp  students  (-09%) 

4.  review  chapter  before .exam  '   .       *  (-08%) 

5.  use  a  textbook  which  Is  more  Interesting^  to  read  (-08%) 

6.  c^se  using  the  textbook  (+08%) 

7.  prbVide,  students  with  time  in  class  to  get  together  and 

d1scu^  ideas  '  (+06%) 


8/  allow  students  to  read  textbook  on  their  own  rather  than 

^  making  reading  assignments  (+05%) 

9.  explain  difficult  vocabulary  (-05%) 

10.  identify  which  ideas  should  be  remembered  .  (-04%) 

11.  provide  an  outline  or  overview  of  chapter  (-04%) 

12.  use  a  textbook  which  is  easier  to  read  (+03%) 

13.  provide  additional  material  to  read  (+02%) 

14.  spend  time  teaching  reading  skills  (-02%> 

15.  use  a  textbook  which  is  more  up-to-date  (+02%) 

16.  spend  more  time  explaining  the  chapter  before  student^  read 

it                 .                        -  (+01%) 

17.  relate  new^ideas  to  ideas  students  already  know  (+01%) 

18.  •  teach  students  to  idenVh^  rela'tiorT^^) between  ideas  (-01%) 

19.  spend  time  teaching  study  skills      ^  (-01%) 

20.  provide  students  with  time  Iryclass  to  read  •  (00%) 

21.  teach  students  to  identify  important  ideas  .  (00%) 


n 


5. 
6. 
7. 
8. 
9. 
10. 

n. 

12. 
13. 
14. 

Is. 

16. 
17. 
V^. 
19. 
20. 
21. 


linois  Part  IV  TABLE  23F 

Difference  between  +H1 story  males  &  Biology  males 

allow  students  to  r'eafi^xtbook  on  their  own  rather  than 
making  reading  assignments 

review  chapter  before  exam 

provide  students  with  time  in  class  to  get  together  and, 
discuss  ideas 

assigV)  additional  activities  which  will  he>p  students 
underyfeaii]l^«wideas  ^ 

cease  using  the  textbook 

provide  students  with  time  in  claA  to  read  ^ 
u^e>^  textbook  which  is  more  up-to-date 
provide  questions  to  guide  students'  reading 
explain  difficult  vocabulary 

provide  an  outline  or  overview  of  the  chapter  J 
teach  students  to  identify  relationships  between  ideas 
relate  new"  ideas  to  ideas  students^l ready  know 
teachVstudents  to  identify  important  ideas  ' 
use  a  textbook  which  is^more  interesting  to  read 
spend  more  time  explaining  the  chapter  before  students 


read  it  ' 
provide  additional  material  to  r^d 
spend  time  teaching  rea<iing  skills 
identify  which  i,deas  should  be  remembered 
discuss  information  not  covered  in  the  "chapter 
spend  time  teaching  study  skills^ 
use  a  textbook  which  is- easier  to  read 


(+25%) 
(+18%) 

(+18%) 

(-16%) 
(+12%) 

r+11%) 

(+07%) 
(+06%) 
(-05%) 
(+05%) 
(+04%) 
(+03%) 
(+03%) 
(+03%) 

(-02%) 
(+02%) 
(+02%) 
(-01%) 
(-01%) 
(+01%) 
(-01%) 


r 
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Illinois—Part  IV               TABLE  2 3G 

Difference  between  +H1 story  females  &  Biology  females 

■  ■  ,      ■    ,  '  '     ,  ■  '            -"  '           ■             .  ' 

1. 

allow  students  to  read  textbook  on  their  own  rather 
than  paiking  reading  assignments 

(+23%) 

2. . 

assign  additional  activities  which  will  help  students 

iinrlpv^ch Anrl  npw  irlpri^                                                  ^  i 
uiiuci  d  uaiiu  lie**    1  ucGi 9 

■J 

y*p\/ipw  rht^nf^t*  hp'Forp  pyAm 

4 

di^rijss  information  not  covered  in  the  chaoter 

Y-ld^^ 

c 

nrnviirip  ArlHitional  matprial   to  rpari  "* 
pi  uv  1  uc  auvi  1  u  1  una  i    ma  uci  i  a  i  pcau 

III  • 

ij^p  a  '  tpythnnk  whirh  i^  more  uD^to-date 

lid  C     d    .  VC  A>U  V  WIN     V*l  1  1  w  1 1      1  ^     tH\J  IwUI'WwSJU^^w  i 

^-in°/v 

\  •  1  U/o  1 

7 

nrnwiHp  An  o\/pr\/ipu  ^or  outlinp  of  the  chaoter 

U 1  U  V  1  uc    Gil  1     wVCiVlwW              WUUilllw    wl      \«llw>    V*l  ivA  ^  ^«  w  1 

y  •  UO/O  / 

nrnv/irlp  nijpQtion^  to  ouirle  students*  readino 

q 

11  CP  A  tpythook  whi  rh  i  5  more  in  teres  ti  no  to  read 

Gl     uCAUWWIV    Wll  Iwll    .1^     lliw  1  w      III         1              l<*^  1 

\     UO/O  f 

in 

pynl^i.n  difficult  vocahularv 

\    U  f  /o  ^ 

n 

Drovide  students  with  time  in  class  to  read 

^IWVIUC      JwUUwIlv^      rffl^ll      \0  t  IIIW       III      wIVIirf.*'       Vw      |%«M>«  ^ 

12 

cnpnd  timp  tpachino  studv  skills 

9  pC  1 1 U     U  1 1 1  iC     UCOIwll  IIIH     ^wlJ  U  Jr     J  l\  1  1  1  J 

(+05^1 

1 

rpl Atp  npw  i deai;  to  ideas  students  al readv  know 

1 A  A 

fpArh  % tiidpnt c  to  iHpnti^v  rpl at ionshi OS  between  ideas 

CCOV«il    duUUCIIud     1*1*     I^CIIul^Jr     ICiai*lwll3llipp          i*¥»cwii     i  vjwv* 

\  •  Ut/o  f 

1  ^ 

cnpnH  f  imp  '^PA^*h  i  nn  rpad  i  noskills 
b  pciiU   c  1  iiic   ucai«i  1 111^  1  cuu  iii^3iviiid 

7+nA°/  \ 

16. 

teach  students  to  identify  important  ideas 

17, 

cease  using  the  textbook 

(-03%)  , 

18. 

use     textbook  which  is  easier  to  read 

(+02%) 

19. 

identify  which  ideas  should  be  remembered 

(-01%) 

20. 

provide  students  with  tiriie  in  cliaiss  to  get-together  and 
discuss  ideas 

(+01%) 

21. 

spend  more  time  explaining  the  chapter  before  students 
read  it 

(00%) 
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TABLE  24 


N  =  yk7     n  =  204.    '  n_  =  U3 
Total        History  Biology 
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I.  (Item  18)  Describe  step  by  step  how 
you  study  a  textbook  chapter.  Be 

sure  to  include  any  additional  * 
methods  of  study  you  uise  which  are 
not  men-tioned  above. 

class  notes  .  23(.066) 

^vyorksheets/handouts  38(jl) 

study  pictures-                        '  ^^(.012) 

look  up  words  in  the  glossary  - 

clads  ass }gnments  - 
f i Ims/f 1 1ms  trips 

II.  (item  13)  Please  describe  any  other 
strengths  and  weakness  of  your 
textbook. 

Strengths : 

inclusion  of  pictures,  charts,  38(.ll) 
maps,  graphs,  diagrams 
/        -boldface  print  23(.066) 
defines  word  clearly  - 
i  ndex 

Weaknesses: 

text  'is  boring         •  29(,083) 
no  glossary /need  better  glossary  8 
*  chapters  too  long/too  many  3(.Ol4) 
topics  in  a  topic 

not  enough  pictures/diagrams  ,  - 
dates  not   repor ted^ chrono- 
logical 1  y  .    '  '  ■ 
drawings  unrea 1 i  st  ic 

III.  (item  19)  Please  describe  any  other 
difficulties  you  have  when  you  study 
a  chapter  in  your  text. 

:       text   IS  boring  .  27(.078)' 

chapter^  too  long  3(.009) 
not  enough  t  i  me 
classmates  talking 
hard  to  visualize  things 

IV.  (item  22)  PJease  describe  anythihg 
else  you  would  suggest  the  teacher 

^     might  do  to  hej^  you  study  a 
chapter  in  your  text 

administer  practice  Lcs ts/qui zes  7(.020) 
show  more  f  i 1 ms  ;  - 

prpv i de  notes  - 
field  trips 

shorter-  assignjnents  -  , 

go  over  test  after  LcsL  hns 
been  tak^n  *        ^  ^ 

require  more  lab  work 
require  more  projects 
al l  ow  more  t  ime 


31(.15) 
2(.01) 


2(.0l) 


13(.062) 
14(.019) 


21 (.103) 
2 (.009) 
3(.015) 


7(.03M 


10 ( .049) 
2 (.009) 
3C.015) 
3(.015) 


3(.015) 
!0(.0'»9) 

3(.015) 
3(.015) 
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2  (",009) 


U(.098) 
7('.0i.8) 
2  (.014) 
2(.01i») 
2(.01i») 


25 (.173) 

19(.133) 
10 (.069) 
4(.019) 

8(.056) 
6(.0i»2) 
2  (.014) 

7(.048) 


4(.028) 


17(.119) 
1  (.007) 


1  (.007) 


4  (.028) 
3(.02l) 

'2  (.014) 

2 (.01 4) 
2(.014) 


Appendix  D 
Complete  Set  of  Texts,  Maps,  and  Lists 
of  Relationship  Propositions 
Crefer  to  Section  III,  Part  2) 
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#101  Metamorphosis  of  the  Frog 

(no  heading) 

The  change  to  an  adult  frog  is  amazing,  /irst,  Wnd  legs 
appear  on  the  tadpole's  fishlike  body.    The  fron^f^egs  start  to 
-  form  at  about  the  same  time.  '  But  they  remain  hiclden  under  the 
tadpole's  fisK-l ike  operculum  for  a  while.    When  the  front  legs 
do  appear,  the  tadpole  starts  resorbing  its  tail.    The  tadpole 
does  not  shed  dr  eat  the  tail. 

Near  the  end  of  the  metamorphosis,  the  moutK  broadens  and 
teeth  develop.-  As  these  external  changes  happen,  internal  changes, 
also  occur.    A  saclike  chamber,  resembling  the  swim  bladder  of  a 
fish,  forms  behind  the  tadpole's  throat.    This  divides  into  two 
sacs,   which  become  the  lungs.    The  heart  develops  three  chambers. 
The  gill  arteries  change  into  the  carotids,  aortic  arches,  and 
pulmoqutaneous  arteries.    Soon  the  gills  stop  .functioning' and  the 
tadpole  starts  swimming  to  the  water's  surface  to  gulp  air.  At 
this  time,  the  tadpole's  thin  skin  and  broad,  flat  tail  still  play 
important  roles  in  respiration* 

,  '       Even  before  the  tail  is  completely  resorbed,  the  tadpole 
starts  moving  out  on  the  land;    From  this  point,  the  tadpole  is 
considered  a  young  frog.    The  young  frog  usually  takes  about  a 
month  to  become  a  full-grown  frog, 

.  •       ■  /  ■ 

The  metamorphosis  of  the  leopard  frog  takes  from  two  to  three 
months.    Adult  leopard  frogs  usually  appear  around  July  first. 
Bullfrogs    usually  spend  two  winters  as  tadpoles.  And  it  may  be 
three  years  before  the  adult  bullfrog  is  fully  formed. 
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#  101— METAMORPHOSIS  OF  THE  FROG 


DEF:    the  change  to  an  adult  frog 


Is  amazlno 


First  (Phase) 


hind  leos  appear  on  tadpole's  body 


f1sh>11ke 


front  legs  start  to  form 


at  about  the  same  time 
(as  hind  leasj  


thev  remain  hidden 


fish- like 


for  a  while 


Front  lecfs  do  appear 


tadpole  starts  resorbina  tail 


tadpole  does  not  shed  or  eat  the  tall 


Wear  the  end  of  metanorphosls 


external  changes  happen 
I  mouth  broadens 


teeth  develop 


Internal  changes  also  occur 


sac- nice  chamber  ^ forms; 


resembles  the  swim 
bladder  of  a  fish 


forms  behind  tadpole's  throat 


divides 
into 
two 
sacs 


becomes 

the 

lungs' 


[heart  develops  three  chambers; 


gill  arteries  change 
Unto  the  carotids 


3   Unto  aortic  arches  | 


into  pulmocutantous 
arteries  


respiration  (changes) 


gills  stop 
functioning 


tadpole  starts  sw1mm1,ng  to  water *s  surface 
^  I  to  gulo  afr 


tadpole's  thin  skin  still  plays  important  role  in  respiration 


tadpole's  broad  tall  still  plays  Imporlynt  role  In  respiration 


tadpole  starts  moving  out  on  land 


before  tail  completely  resorbeT 
tadpole  Is  considered  a  young  rrog 
I  from  tMs  point  on 


becomes  a  full-grown  frog 


usual  ly  takes  hbtiiZ  a 
month 


nwt/imnrphAsis  of  leopard  frog 


takes  two  to  three  months 


adults  appear  around  July  T 


metamorphosis  of  bullfrog 


usually  spend  ^  winters 
as  tadpole 
may  be  J 


years 


aduir  ruf  ly 
formed 


ERIC 


126 


#101:    METAMORPHOSIS  OF  THE  FROG 
,  embed- 


dedness 


CONCEPT  A 


RELATION- 
SHIP 


CONCEPT  B 


  0  0 

1.  metamorphosis  of  the  frog  DEF 
1.1 

0  1 

2.  metamorphosis  of  the  frog  PROP 
1.2 

0  0 

3.  metamorphosis  of  the  frog  PROP 
1.3 

1  1 

4.  first  (phase)  PROP 
2.2 

1  1 

5.  tadpole's  body  PROP 
2.22 

6.  first  (phase) 
2.2 

^1  1 

7.  front  legs  start  to  form  PROP 
2.22 

1  1 

8.  front  legs  start  to  form  PROP 
2.22 

1  1 

9.  front  legs  start  to  form 
2.25 

1  1 

10.  they  remain  hidden  PROP 
2.222 

1  1 

11 .  opercul um  PROP 
2.2222 

1  1 

12.  they  remain  hidden  PROP 
2.222 

1  0 

13.  first  (phase)  PREC 
2.6  -  , 

^        1  1 

14.  front  legs  do  appear  PROP 
3.2 

1  0 

15.  front  legs  do  appear  PROP 
3.2 


1 

change  to  an  adult  frog 
1 

is  amazing 


Rel.  Props.  H  6,13,16,37,41 
1 

hind  legs  appear  on  tadpole's 
body 

1 

fish-like 

1 

PROP     front  legs  start  to  form 

1 

at  about  the  same  time  (as 
the  hind  legs) 

they  remain  hidden 

1 

NOT  SIM   they  remain  hidden 
1 

under  operculum 
1 

fish-like 


1 


for  awhile 


1 


front  legs  do  appear 
1 

tadpole  starts  resorbing  its 
tail 

1 

tadpole  does  not  shed  or  eat 
the  tail 
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#101:    METAMORPHOSIS  OF  THE  FROG 


embed- 
dedness 


CONCEPT  A 


RELATION- 
SHIP 


1 


16. 

\ 

17. 

18. 
19. 
20. 

21. 
22. 
23. 
24. 
25. 
26. 
27. 
28. 
29. 
30. 


0 

PREC 


0 

PROP 


0 

EXAMP 
0 

EXAMP 
0 

PROP 


front  legs  do  appear 
3.6 

1 

ear  the  end  of  metamor- 
phosis 
4.2 

1 

external  changes  happen 
4.23 

1 

external  changes  happen 
4.23 

1 

near  the  end  of  metamor- 
phosl s 
4.2 

1  0 

internal  changes  also  occur  EXAMP 
4.23 

1 

saclike  chamber  (forms) 
4.232 

1 

saclike  chamber  (forms) 
4.232 

saclike  chamber  (forms) 
4.236 

1 

divides  into  two  sacs 
4.236 

1  0 
internal  changes  also  occur  EXAMP 
4.23 

1  0 
internal  changes  also  occur  EXAMP 
4.23 

1 

gill  arteries  change 
4.233 

1 

gill  arteries  change 
4.233 

1 

gill  arteries  change 
4.233 


 CONCEPT  B 

near  the  end  of  metamorphosis 


1 

PROP 
1 

PROP 
0 

PREC 
0 

PREC 


0 

EXAMP 
0 

EXAMP 
0 

EXAMP 


1 

external  changes  happen 


1 

mouth  broadens 
1 

teeth  develop 
1 

internal  changes  also  occur 


Rel.  Props,  a  22,24,25 

1  . 

resembles  the  swim  blSdder 
of  a  fish  c 

1 

forms  behind  tadpole's  throat 
1 

divides  into  two  sacs 
1 

becomes  the  lungs 
1 

heart  develops  three  chambers 
1 

gill  arteries  change 
1 

into  the  carotoids 
1 

into  aortic  arches 


into  pulmocutaneous  arteries 
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#101:    METAMORPHOSIS  OF  THE  FROG 


embed- 
#  dedness 


CONCEPT  A 


RELATION- 
SHIP 


CONCEPT  B 


 ]  0 

31.  internal  changes  also  occur  EXAMP 
4.23    .  . 

0  / 

32.  respiration /changes) 
4.232 

1 

33.  gills  stop  functioning 
4.2327 

1 

34.  tadpole  starts  swimming  to  PROP 
the  water's  surface 

4.23272 

0 

35.  respiration  changes 
4.232 


36.    respiration  changes 
4.232 


1 


0 

PROP 
0 

CAUS 
1 


0 

PROP 


0 

PROP 


0 

PREC 


37.  near  the  end  of  metamor- 
phosis 

4.6 

1  1 

38.  tadpole  starts  moving  out  PROP 
on  land 

5.2 

1  1 

39.  tadpole  starts  moving  out  PROP 
on  land 

5.2 

1  1 

40.  tadpole  considered  a  young  PROP 
frog 

5.22 

1  1 

41.  tadpole  starts  moving  out  on  PREC 
land 

5.6 

1  1 

42.  becomes  a  full  grown  frog  PROP 
5.6 

0  0 

43.  metamorphosis  of  the  frog  EXAMP 
,  1.3 


respiration  (changes) 


ReV.  Props. #  33 
1 

tadpole  starts  swimming  to 
the  water's  surface 
1 

to  gulp  air 


1 

tadpole's  thin  skin  still 
plays  important  role  in 
respiration 

1 

tadpole's  broad  tail  still 
plays  important  role  in 
respiration 

1 

tadpole  starts  moving  out  on 
land 

1 

before  tail  is  completely 
resorbed 

1 

tadpole  considered  a  young 
frog 

1 

from  this  point  on 


1 

becomes  a  full  grown  frog 


1 

usually  takes  about  a  month 
1 

metamorphosis  of  leopard  frog 
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#101:    METAMORPHOSIS  OF  THE  FROG  ^ 

#     embed-  _  ^^kuil^^'   CONCEPT  B 

dedness         CONCEPT  A  .^HiT  ^  

44.  metamorphosis  of  leopard  PROP  takes  2  to  3  months 
frog 

45.  mewmorpholls  of  leopard  pioP  adults  app«r  around  July  1 
frog 

-    46.    ™tamorpho?ls  of  the  frog  EX°AMP  metamorphosis  of  bullfrogs 

47.  metamorpholls  of  bullfrogs  pioP  ^^JJ^]^,,'^^""  ^  " 

48.  lelorpho'sls  of  bullfrogs  pJoP  -^^^-^^  yeUefore  adult 

49     maybeS  yLs  P"EC    adult  fully  formed 

1.326 


/ 
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#102— Circulatory  System  of  the  Frog 

4 

The  Circulatory  System 

The  circulatory  system  of  the  frog  is  a  step  more  complex 
than  that  of  the  fish"    This  represents  a  step  toward  the  higher 
vertebrates.    One  of  these  advances  is  the  heart.   The  frog  heart 
has  three  chambers.    There  are  two  atria  (auricles)  and  a-  muscular 
ventricle!    Deoxygenateiji  blood  flows  into   the  right  atrium  from 
various  parts  of  the  body.    When  the  lungs  are  used,  oxygenated 
blood  from  the  lungs  flows  into  the  left  atrium.    Both  atria 
contract  at  the  same  time.    This  forces  blood  into  the  ventricle. 
The  ve/itricle  then  contracts  and  pumps  blood  out  of  the  heart. 
The  blood  leaves  through  a  large  vessel  that  lies  against  the 
front  side  of  the  heart.   This  is  called  the  conus  arteriousus. 
This  large  vessel  immediately  divides  into  two  branches,  the  right 
and  left  truncus  arteriosus.    Each  of  these  again  branches  into 
three  arches.    The  anterior  pair  are  the  carotid  arches.  These 
carry  blood  to  the  head.   The  middle  pair  are  the  aortic  arches. 
They  transport  blood  around  the  right  and  left  sides  of  the  heart. 
They  Join   below  the  liver  to  form  the  dorsal  aorta.   This  great 
artery  carries  blood  to  muscles,  the  digestive  organs,  and  other 
parts  of  the  body.    The  posterior  pair  of  arches  are  called  the 
pulmocutaneous  arches.    They  carry  blood  to  the  lungs,  skin  and 
mouth. 

The  blood  that  returns  to  the  frog's  heart,  after  a  trip 
through  the  body,  has  lost  most  of  its  oxygen.   This  blood  is 
loaded  with  carbon  dioxide  and  other  cell  wastes.   Three  large 
veins  carry  blood  back  to  the  heart.    These  are  called  the  venae 
cavae.    They  join   a  triangle-shaped,  thin-walled  sac,  called  the 
sinus  venosus,  at  the  back  of  the  heart.    This  empties  into  the 
right  atrium. 
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#  102- 


-CIRCULATORY  SYSTEM  OF  THE  FROG 


Complex 


> 


circulatory  system  of  the  fish 


complex 


a  step  more 


represents  a  step  toward  the  higher  vertebrates 


characterized  by  a  number  of  advances 


the  frog  heart 


one  of 


advances 


two  atria                                           —  — 

^  (or)  auricles   ■  — 

rlqht  atrium 

left  atrium 

deoxygenated  blood 
flows  Into  here 

oxygenated  blood 
flows  Into  here 

from  various  parts 
of  the  bodv 

from  the  VDRS 

when  the  lungs  are  used 

ventricle 


muscular 


\ 


A  trip  through  the  body 


both  artria  contract 
at  the  same  time  


forces  blood 
Into  ventricle 


ventricle 
contracts 


ventricle  pumps  blood  out  of  the  heart 


blood  leaves  through  a  large  vessel 


lie  against  the  front  side  of  the  heart 
called  conus  arteriosus  ~~ 


Immediately  divides  Into  2  branches 

right 

left 

truncus 

truncus 

arteriosus 

arteriosus 

each  branches  Into  3  arches 


anterior  pair 


called  carotoid  arches 
carry  blood  to  the  head 


posterix  pair 


called  puimocutaneous 
arches 


'to  lungs 


I  to  skin 


ftp  mouth 


middle  pair" 


called  aortic  arches 

transport  blood  around  tne  right  and 

left  sides  of  the  heart   


join  below  the  liver 


to  form  the  dorsal  aorta 


great  artery 


carries  blood 
I  to  muscles 


I  to  digestive  Oif'g&ns  | 
I  to  other  parts  of  the  body 


(continued) 
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(continuation  of  #  102) 


blood  carried  by 

three  la^ae  veins        .  . 

— > 

Join  a  sac 

called  the  venae  cavae " 

called  thu  <;1nij<;  v<nn«»ci 

arlangle-shaped 

MfjuL-M^K ll  III  1  li  ^^^^^M 

«;th1n  walled 

a'r»%tift_back  of  the  heart 

blood  empties  Into 
right  atH4jm  


N 

blood 

that  Is  returning  to  the  frog's  heart 

 j2  1  

has  lost  mo^t  of  ttt  <;  o»yff<>n  

Is  laoded  with  carbon  dioxide 

Is  loaded  with  other  cell  wastes 

/ 


13*3 


V. 


1102:    CIRCULATORY  SYSTEM  OFJHE  FROG 

RELATIONr 
CON  CEPTA  SH I P 

1   1 

1.  circulatory  system  of,  the      PROP  complex 

\  frbg 

1.2.  .  , 

1  ■  I 

2.  complex 
1 . 28 

1 

3.  circulatory  system  of  the 
f1sh 
1 . 282 

1 

74.  complex 

/       1  ?? 


1  .  ' 
MOR  TH  ^^J*^  Props.  #3 

PROP     complex  * 
i 


1 


-  f 


PROP     a  step  more 


) 


1.22 

5.  complex 
;>  1.22 


1  4» 


1 


PROP     represents  a  step  t'oward  * 
the  higher  vertebrlates 

PROP     characterized  by /4  number 
of  advancer  ' 


6.    represents  a  step  toward 
'the  higher  vertebt-ates  • 
'  1.222 

7/  ^characterized  by  a  number     EXAMP     the  frog  heart 
of  examples 


1 


1 


1.2223 


1 


1 


1 


8.  the  frog  heart 
2.2 

1 

9.  the  frog  heart 
2.2 

1 

10     has  three  chambers 
2.23 

1 

11.  two  atria 
2.234 

1 

12.  two  atria 
2.Z33 

1 

13.  right  atrium  , 
2.2332 

1 ' 

14.  deoxygenated  blood  flows 
into  here 

2.23322  . 


PROP  one  of  these  advances 

PROP  has  three  chambers 

.  1  .  1 

&XAMP  two  atria 


0 

SIM 


auricles 


EXAMP     right  atrium 


1 


1 


PROP     deoxygenated  blood  flows  into 
here 

1        '  1 
PROP     from  various  parts  of  the 
body  • 


ERIC 


-134 


#102:    CIRCULATORY  SYSTEM  OF  tHE  FROG  . 

e.be/^^~^^„^  ,       RELATION-  '  .    ^  ^^^^^^ 

M     dednfss  CONCEPT  .A  SHIP  .  ^  

~                    ^                         EXAMP  left  atrium 

15.  two  atria                       •    '^^""'^  ^  ?\ 

2.233                        .           ^  •  'U\ 

\                        PROP  'oxygenated  blodd  flows  into 

16.  left  atrium-  .  ^^^^ 

2.2332                                   ^  "^"^  1 

17.  oxygenated^lood  flows  into    PROP  from  the  lunfls 
here 

5.23322                                  ^  1 

18.  oWnated\lood  flows  into    PROP  when  the  lungs  are  used 


here 

2.23322  ^  ^  1  * 

19     has  threr  Chambers  v     ,  EXAMP  ventricle 

"    2.23     '  ^  ]      '  ' 

^  .  ,    ^  "      PROP     muscular  * 

20.  ventricle 

2.232  Q  0 

^       i.  PRHP     a  trio  through  the  body 

21.  circulatory  system  of  the      PRU^'     a  ^rip 

frog  , 
^1.2  1 

°    u        KnHw  '       PROP     Rel.  Props.  123,24,25,26,29,32; 

22.  a  trip  through  the  body^  PROP 

3.2  »  •  1  1 

^  i.    *  .«m«    fAii«;     forces  blood  into  ventricle  , 

23.  .both  atria  contract  at  same   CAUb     rorces  ui 

.  '    time  f  : 

3.27  ^  1 

24     'forces  bloid  into  ventricle    PREC  ventricle. contracts 
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#103— structures  of  a  Snake's  Head 
The  Structures  of  a  Snake's  Head 

The  snake's  mouth  is  large.    On  the  upper  jaws  there  is  a 
double  row  of  teeth.    On  the  lower  jaw  is  a  single  row.    These  teeth 
are  not  used  for  chewing.    But   they  are  necessary  to  hold  prey, 
which  is  swallowed  whole.  "  - 

Snakes  have  a  very  acute  sense  of  smell.    Olfactory  never 
endings  lie  In  the  nasal  cavities.    These  cavities  open  as  paired 
nostrils  near  the  front  of  the  head.    The   sense  of  smell  is  aided 
by  a  forked  tongue.    This  tongue  rests  in  a  sheath  on  the  floor  of 
the  mouth.    It  flicks  out  through  a  small  opening  that  is  le-ft  when 
the  jaws  are  closed.    The  tongue  picks  up  dust  and  odor-bearing 
particles  from  the  air.    And  it  transfers  them  to  tiny  pits  in  the  ^ 
front  of  the  roof  of  the  mouth.    These  pits  are  called  Jacobson's 
organs.    They  contain  nerve  endings  that  are  very  sensitive  to 
odors . 

Unlike  other  reptiles*  snakes  have  no  lids  on  their  eyes. 
Instead,  a  transparent  scale  covers  each  eye.    Just  before  molting, 
this  scale  becomes  cloudy.   This  makes  vision  difficult  for  a  time. 
The  eyes  can  turn  in  their  sockets.    And  a  moveable  lens  focuses 
the  eye  sharply,  especially  at  close  range.    Different  snakes  have 
different  shaped  pupils  in  their  eyes.    Those  most  active  in  day- 
light have  round  pupils.    Those  most  active  at  night  have  elliptical 
pupils  similar  to  those  of  cats. 
f 

The  ears  are  embeded  in  the  skull.    There  are  no  external 
openings.    Thus,  the  snake  cannot  hear  vibrations  carried  by  air. 
Instead,  the  skull  bones  carry  vibrations  to  the  highly  sensitive 
ear  mechanisms. 
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The  Reproductive  System 

In  bbth  sexes,  the  frog's  sex  organs  are  Internal.    Thus,  It 
Is  hard  to  tell  the  sexes  apart,  except  during  the  breeding  season. 
At  this  time,  the  thumbs  of  the  males  are  enlarged. 

The  male  reproductive  organs  are  two  oval  testes.    The  testes 
are  a  creamy-white,  or  yellow  color.   They  lie  in  the  back,  pne  of 
each  side  of  the  spine.  In  the  anterior  region  of  the  Mdneys. 
Sperm  cells  develop  In  the  testes.    The  sperms  then  pass  through 
tubes,  the  vasa  efferentia.  Into  the  kidneys.    When  the  sperms  are 
dIscTiarged,  they  pass  through  the  ureters  Into  the  cloaca.  Some 
frog  species  have  an  enlargement,  the  seminal  vesicle,  at  the  base 
of  each  ureter.  ' 

In  the  female  f^og.  the  eggs  develop  in  a  pair  of  large  lobed 
ovaries.    The  ovaries  lie  along  the  back  above  the  kidneys.  During 
the  breeding  season,  the  eggs  enlarge  and  burst  through  the  thin 
ovary  walls.    This  frees  the  eggs  Into  the  body  cavity.  The 
abdominal  muscles  work  the  eggs  toward  the  anterior.    Here  funnel - 
like  openings  to  the  oviducts  gather  the  eggs.    Oviducts  are  long 
and  colled,  and  are  lined  with  ciliated  cells.    The  cilia  fan /the" 
eggs  into  the  oviduct  openings.    Oviducts  ^ead  into  the  cloaca. 
Near  the  openings  to  the  cloaca,  the  walls  of  the  oviduct  secrete 
a  jelly  like  substance.    This  substance  surrounds  each  egg.'  There 
is  a  saclike  uterus  at  the  base  of  each  oviduct.    The  eggs  are 
stored  in  the  uterus  until  they  are  laid. 
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Muscle  Structure  .  ' 

Striated  muscle  makes  up  about  40  percent  of  the  weight  of 
the  body.    It  is  the  most  common  Single  type  of  tissue.    As  was 
pointed  out  in  Chapter  4,  striated  muscle  tissue  is  composed  of 
elongated,  hiohlv  soecialized  cells,  the  muscle  fibers.  Each 
fiber  is  apparently  crossed  by  numerous  alternately  light  and 
dark  bands,  the  striations.    Under,  the  ordinary  light  microscope, 
these  bands  appear  to  be  corvtinuous  from  one  side  of  the  fiber  to 
the  •other'.   With  the  aid  of  an  electron  microscope,  the  bands  are 
seen  to  be  features  of  the  extremely  smal 1  myofibrils  which  are  very 
closely  packed  together  and  run  lengthwise  through  the  fiber.  As 
shown  in.  Fig.  6-1 ,  each  fiber  is  surrounded  by  a  thin  layer  of 
connective  tissue,  the  sarcolemma.  _   

When  an  exceptionally  wel 1 -prepared  section vOf  striated 
muscle  tissue  is  viewed  With  a  light  microscope,  a  series  of  dark 
bands  are  seen.    These  are  called  the  A  bands,  and  in  the  middle 
of  each  is"  found  a  narrow  light  area,  the  II  band.    On  either  side 
of  the  A  band  is  another  light  area  knows  as  the  I  band  which  is 
crossed  by  a  very  thin  1 i ne  of  darker  material ,  the band.    The  ; 
material  lying  between  the  two  Z  bands  makes  up  what  is  now 
considered  to  be  the  unit  of  structure  of  a  muscle  fiber,  the 
sarcomere .    The  banding  of  the  myofibril  is  determined  by  the  , 
distribution  of  the  materials  composing  it, 
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#106— How  Muscles  Work 

(no  heading) 

We  have  seen  that  muscle  action  is  the  result  of  chemical 
processes  within  the  individual  muscle  cells.    A  more  general^ 
consideration  of  the  anatomical  location  and  action  of  some  of 
these  muscles  will  show  how  this  muscular  energy  is  transformed 
into  mechanical  energy  in  the  form  of  motion. 

Muscles  are  able  to  move  bones  because  of  the  location  of 
the  muscle  attachments.    These  points  of  attachment  are  called  the 
origin  and  the  insertion.    The  attachment  to  the  bonp  that  serves 
as  a  relatively  fixed  basis  of  movement  is  the  origin.  The 
insertion  is  the  point  of  attachment  to  the  bone  which  is  moved. 
Most  muscles  are  attached  to  the  periosteum  of  a  bone  by  means  of 
a  tendon;  however,  some  make  direct  contact  with  the  periosteum, 
while  others  are  attached  by  a  sheet  of  heavy  connective  tissue. 
The  belly  of  the  muscles  contains  the  body  of  the  muscle  tissue 
itself.    To  understand  the  movement  made  possible  by  the  action 
of  a  specific  muscle,    it  is  necessary  to  know  its  origin  and 
insertion. 

Consider,  for  example,  the  action  of  the  biceps  brachii, 
conroonly  called,  the  biceps.    This  is  a  large  muscle  on  the  front 
of  the  upper  arm  that  can  be  felt  when  the  arm  Is  bent  at  the 
elbow.    Because  of  the  placement  of. its  origins,  it  not  only  brings 
about  a  movementof  the  forearm    in  a  vertical  plane,  but  also 
gives  it  a  rotary  motion,  such  as  that  used  with  a  screwdriver. 
In  Fig.  7-1  we  can  see  that  both  the  biceps  and  the  triceps  brachii 
or  triceps  (on  the  back  of  the  arm)  have  more  than  one  origin  each: 
the  triceps  has  three  points  of  origin  and  derives  its  name  from 
that  fact  (Latin,  tres,  three  +  c^fput,  head),  and  the  biceps  has 
two.    It  will  be  notia"  that  these  muscles  have  several  points  of 
insertion,  and  because  of  this,  complex  action  is  possible. 
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#107  Skeletal  Muscles  Work  1n  Pairs 


(no  heading) 


The  action  of  the  biceps  and  the  triceps  when  the  arm  Is 
flexed  or  extended  at  the  elbow  Illustrates  an  Important  character- 
istic of  muscles:    most  skeletal  muscles  work  In  pairs.    For  each 
musOilar  contraction  that  brings  about  motion  In  one  direction, 
there  Is  possible  a  motion  In  the  opposite  d1rect1x)n  which  depends 
upon  the  contraction  of  the  other  member  of  the  muscle  pair.  For 
example,  when  you  flex  your  arm,  the  actlpn  Is  largely  the  result 
of  the  contraction  of  the  biceps  muscle.    But  when  you  extend 
your  arm,  the  triceps  rftuscle  contracts.    These  opposing  actions 
are  brought  about  by^  the  so-called  antagonistic  muscles. 

The  contraction  of  pairs  of  antagonistic  muscles  Is  controlled 
by  the  central  nervous  system.    Although  the  exact  mechanism 
Is  not  clearly  understood.  It  appears  that  the  contraction  of  a 
muscle  stimulates  nerve  cells  thdt  lie  within  It.    These  nerve 
cells,  known  as  stretch  receptors,  send  a  volley  of  nervous 
Impulses  to  the  central  nervous  sustem--to  either othe  brain  or  the 
spinal  cord.    A  nervous  Impulse  prevents  the. muscle  from  contracting 
rather  than  causing  It  to  relax.    The  resulting  smooth  action  of 
antagonistic  muscles  Is  due  to  this  condition  known  as  reciprocal 
Innervation. 
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#108  Muscles  in  the  leg  (below  the  knee) 
(no  heading)  '  ^ 

In  the  leg  (below  the  knee)  are  two  muscles  that  form  the 
calf  of  the  leg,  the  more  prominent  beirjg  the  gaitrocnemius.  It 
has  its  origins  on  the  base  of  the  femur,  with  its  insertion  in 
the  heel  bone  (calcaneus)  by  means  of  the  .heavy  Achilles'  tendon. 
Closely  associated  with  the  gastrocnemius  is  the  soleus.  -This 
originates  on  the  upper  surfaces  of  the  tibia  and  fibula  and  its 
tendon  blends  with  that  of  the  gastrocnemius.    The  action  of  both 
of  these  muscles  is  to  pofnt  the  foot  downward,  and  their  general^ 
form  and' course  can  be  noted  with  each  step  as  the  heel  is  raised 
form  the  floor  in^  walking.. 

'  ■  ■     ■  . 

The  front  of  the  }eg  is  characterized  by  a  complex  group  of 
muscles,  some  of  which  are  quite  conspicuous  in  their  action, 
while  others  show  merely  as  rippling  motions  under  the  skin.  There 
Is  one  muscle  of  special  interest  because  of  its  ability  to  flex 
the  foot  strongly  at  the  ankle.    This  is  the  tibialis  anterior 
which  lies  just  outside  of  (lateral  to)  the  shin  bone.    The  origin 
of  this  muscle  is:  on  the  front  of  the  tibia  and  its  insertion  is 
on  one  of  t'he  tarsal  bones.    As  a  result  of  its  contraction,  the 
foot  is  drawn  upward,  allowing  the  weight  of  the  body  to  fall  on 
the  heelv  The  tibialis  anterior  is  frequently  affected  by  the  type 
of  poliomyelitis  that  injures  the  nerves  controlling  the  muscles 
which  are  situated  in  the  front  of  the  legs. 
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#109  The  Phylum  Chordata 
Chordates— The  Most  Complex  Form  of  Animal  Life 

The  phylum  Chordata .contains  the  most  complex  animals  that 
have  ever  lived  on  this  eartfT    This  phylum  has  four  subphyla. 
The  largest  and  most  important  subphylum  is  the  Vertebrata.  This 
subphylum  includes  fish,  amphibians,  reptiles,  birds,  and  mammals. 

Three  factors  make  chordates  different  from  all  other 
animals. 

•  All  chordate  embryos  have  a  rod  of  connective  tissue 
along  the  length  of  the  dorsal  side  of  their  -bod iesT 
This  rod  is  called  a  notochord.    Primitive  chordates 
have  a  notochord  their  entire  lives.    So  do^^orae  .lower 
vertebrates*  such  a5  the  lamprey.    But  the  notbcliord  of 
the  lamprey  becomes  surr*bunded  by  cartilage  parts  .of  the 
spinal  column.    In  other  irertiebrates,  the  notochord.'; 
appears  only  in  the  embryo^,,  But  early  in  life,  it 

changes  into  the  vertjbral-coluaiin,  or  backbone.  .  , 

 r  —        r'-;  --V.^ 

•  All  chordates  have,  a  tu^blilar  nerve  cord.    It  Ties  just 
-    above  the  notochord  ohf^e  dpRsal  side,    The  anterior 

end  of  this  nerve  cord  'develops  into  ^  brain,  th^ 
remaining  part  becomes  tKe  spinal  cord.    Together,  the- 
brain  and.  the  spirraT  cord  i^aki^j  up  the,  central  nervous  -  : 
system.         -  i-^v  '  - 

•  All  chordates  have  pgi^d  #1T^^slits  at  .some  time  in  their 
lives.    These  gill  slits  form  dpenings  in  the  throat.  ~~ 
Fish  and  the  more  p^rimltive  vertebrates  have  gill  slits 
throughout  life,    the  higher !;Vertebrates,  ii:icluding 
reptiles,"  birds, ;and.niaiiina1s,\;lose  their  gill  slits  very 
early  in  life;  "  y 

Of  the  four  Chordate  sutiphyTa,  we  lire  familiar  with  the 
vertebrates.    The  bther  threei  subphyla  are  J<nowrf  more  by  biologists 
These  primitive  chortlates  ar^  all  iTiai!?|ne  ahim^als.    Biologists  find 
them  interesting  because  thay  cah  givf:  us  anjidea  of  what  the  ^ 
ancestors  of  present-day  vertebrates  may  have  been  like. 
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#110  Class  Chondrichthyes 
Cartilage  Fishes 
Sharks >  Rays,  and  Skates   v  ' 

,  Sharks,  rays,  and  skates  belong  to  the  class  Chondrichthyes, 
Thi-s  means  "cartilage  fishes."    It  is  thought  that'  they  developed 
early  in  the  Devonian  period.    Of  the  fishes  that  lived  in  the 
ancient  seas,  many  cartilage  fishes, have  survived  relatively 
unchanged  In  great  numbers.  , 

Sharks  are  similar  to  true  fishes  in  many  ways.    But  they 
have  certain  differences  which  place  them  in  a  separate  class,  ^ 
sharks  have  pi acoid  seal es  whi ch  have  the  same  origin  as  the  ' 
shark's  teetn.^  The  shark's  body  is  toV-pedo-shaped.*  It  has  fins 
like  those  of  true  fishes.   The  long^upper  lobe  of  the  tail  fin 
is  a  characteristic  of  ancient  fishes.    This  type  of  taiKjFin 
forces  the  head  of  the  shart  downward  as  it  moves  through  the 
water.   The  mouth  js  a  horizontal  slit  on  the  ventral  side  of  the 
head.    The  jaws  of  most  sharks  are  lined  with  razor-sharp, 
pointed  teeth..  They  hav6  several  rows  of  teeth.    When  a  tooth  is 
lostr^  another  one  may  move  forward  to  replace  it'.    The  teeth  slant 
backward  to  hold  the  food  securely  in  the  mouth.    This,  combined 
with  great  strength,  make  the  shark  a  fearsome  hunter % 

Wjater  enters  the  mouth,  where  it  passes  oveV  the  gills  on 
either  side  of  the  head.   The  water  is  then  forced  out  through 
separate  pairs  of  giM  slits.    The  gills' are  the  respiratory 
organs  of  the  fish.    The  Shark  has  large,  well -developed  eyes  on^ 
either  side  of  the.  head  above,  the  mouth.    Paired  nostrils  ort  the 
ventral  side  of  the  head  lead  to  olfactory  sacs.   These  olfactory 
sacs  sense  odors  in  the  water.    As  already  mentioned,  shark 
skeltons  are  made  up  of  cartiljage  rather  than  bone.\ 
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\]]  structures  of  the  Trunk  and  Tall  \ 
Structures  of  the  Trunk  and  Tail  ' 

Various  kinds  of  fins  develop  from  the  trunk  and  tall.  But. 
all  fins  are  made  up  of  a  double  membrane  suppongd^by  spiny  rays, 
these  rays  are  composed  of  cartilage*.    Fins  serve  many  purposes. 
And  they  differ  Irt  form  from  species  to  species. 

There  afe  two  kinds  o!r  paired  fins.    These  are  homologous 
to  the  limbs  of  other  vertebrates.    The  pectoral  fins  are  nearest 
the  he&d.  .These  cowogspond  to  the  front  leas.    The  pelvic  fins 
are  posterior  to       below  the  pectoral  fins.    These  correspond 
to  the  hind  legs.    These  pelvic  fins  act  like  oars  when  a  fish 
swimsslo^ly.    They  also  aid  in  steering  and  keeping  balance  when 
the  fish  is  resting.    They  are  also  used  when  the  fish  moves 
backward.     "  '  '^  . 

There  are" several  single  fins.    The  caudal  fin  grows  from 
tht  tail.    It  helps  push  the  fish  fo.rward.~Dorsal  fins  are  found 
along  the  top  of  a  fish's  back.    The  anterior  dorsal  f1n  of  the 
perch  contains  sharp  spines.    Tf?^se  spines  act  as  a  defense 
against  attack.    They  raise  toward  the  head, .making  the  fish  hard 
to  swallow  tail  first.    The  posterior  dorsal  fin  does  not  have 
spines.    Both  dorsal  fins  help  the  fish  stay  upright  while 
swimning.    Another  single  fin,  called  the  anal  ^in,  grows  along 
the  midline  on  the' ventral  side  of -the  fish. Like  the  dorsal 
fins,  the  anal  fin  helps' the  fish  beep  its  balance. 

Powerful  muscles  occupy  the  region  of  the  trunk  above^,  the 
spinal  cplumn.    A  thirtner  muscle  layer  lies  along  the  body  wall  on 
the  sides  of  the  trunk.    The  tail  region  is  nearly  solid  muscle. 

Look  at  a  fish  closely.    On  each  side,  you  can  see  a  row  of 
pitted  scales  in  a  line  .from  the  head  to  the  tail  fin.  These 
make  up  the  lateral  line.    Under  these  scales  lie  nerve  endings 
and  a  narrow  tube.    The  lateral  line  acts  as  a  sense  organ.  It 
picks  up  low-frequency  underwater  vibrations  and  pressure/stimuli. 
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#112  Reproduction  1n  Fishes 

Reproduction  In  Fishes    .  *  . 

•    The  reproductive  organs  of  f1sh  are  called  gonads .  They  lie 
In  the  posterior  part  of  the  body  cavity  above  the  digestive  organs. 
The  opening  from  the  gonads  Is  just  behind  the  anal  opening. 

•    ,  .  J. 

The  reproductive  organs  of  the  female  fish  are  called  ovaries. 
These  produce  eggs  over/a  period  of  several  months.    As  the  eggs 
grow,  the  ovaries  swell  and  may  bulge  the  sldeis  of  the  fish.    In  ^ 
many  fish.  Including  the  yellow  perch,  paired  ovaries  fuse  Into  a 
^single  ovary  during  ttie  embryonic  growth.  • 

In  male  fish,  the  sex  organs  are  called  testes.    These  develop 
sperm  cells.    When  the  female  lays  the  eggs,  or  spawns ,  the  male 
swims  .%ver  them.    The  male  discharges  milt  onto  the  eggs.    Milt  Is 
a  fluid  containing  the. sperm.  'The  sperms  swin  to  the  eggs  and 
fertilize  "them.    This  Is  external  fertilization. 

-  ■  » 

Fertilized  eggs  begin  to  develop  Into  embryos.    This  may 
take  from  a  couple  of  days  to  many  weeks,  depending  on  the  species 
and  the  j*ater  temperature.    As  the  embryo  develops.  It  Is 
nourished  by  special  food  In  the  egg.    This  food  Is  called  yolk. 
The  yolk  Is.  a  large  amount  of  nonliving  material  held  In  the  egg. 
A  yolk  gac  remains  attached  to  a  baby  fish  for  a  short  time  after 
it  hatches. 

In  most  fishes,  spawning  is  not  very  efficient.   Many' eggs 
are  never  fertilized.    Therefore,  they  never  develop.    And,  many 
fertilized  eggs  are  eaten  before  hatching  by  predators.  Those 
baby  fish  that  do  hutch  are  in  constant  danger  of  being  eaten  by 
bigger  fish  and  other  water  animals.  How  does  a  fish  species 
continue  to  survive  under  these  harsh  conditions?   The  species 
survives  because  of  the  large  number  of  eggs  that  are  laid. A 
female  fish  spawns  anywhere  from  500  to  seven  million  eggs 
depending  upon  the  species. 


494 


#  112-RBPRODUCTION  IN  FISHES 


Involves  iqonads 


DEF;    the  reproductive  organs  of  the  fish 


lie  In  body  cavity 


In  posterior  part  of 


above  digestive  organs 


have  openings 


Just  behind  anal  opening 


Ovaries 


DEF;    reproductive  organs  of  female  fish 


produce  eggs 


over  a  period  of  several  mnnf.h<; 


bvarles  swell^y sides  of  fish  mav  bulge 


as  eggs  grow-   .    _       _    _  _ 

oalr^ed  ovaries- mav  fuse  into  a  sinnle  ovarv 


during  embrjronic  growth 


in  man^  Hs 


Testes 


DEF:    sex  organs  of  male 
.   fish  . 


develop  sperm  cells  ; 


^Regroductj[ve  f  rocessj 


External  fertilization 


female  spawns 

DEF;  lays  the  eggs" 


'male  swims 
over  th( 


e  eoas 


male  discharges  milt 
I  hlf  :  (m^lt)  a  fluid 


^  1    onto  the  eggs 

I  SP^^  s^^^^  ^°  ^nq^  ■   I  I  sperm  fertilizes  ^ggs  1 


T^y'tllU^g  eggs  peg  1-n  to  oeveiop 


into  embryos 


may  take  from  a  couple  of  days^ 
to  many  weeks 


/"tfepends  on  species" 


f^^l^mi  6h  WiW  tfetty^e^^&tur^e 
[nourished  by  yolk 


DEF;  (yolk) large  amount  of  non 
Hying  material  held  1n>gg 


special  food  in  the  egg 


bal)y  fish 
Jiatches 


/oik  sac 

remains  attached 
to  baby  fish 


3y  y 
ror  a  snort ^ 

lt%   


takes  place  under  harsh  conditions 


I  spawning  1^  not  verv  efficient  "1 

Imany  eggs  are  never  ferti  11  zed  =^ never  develop  I 

Imanv  eggs  are  eaten  before  hatrhinn  hy  pr»H;^»nrc  I 

Ibabv  fish  mav  be  eaten  bv  bigger  fish  anrf  nthor  w^tor  AnMmU  I 


question;   tiow  does  a  fish  species  continue  to  survive? 


large  numbers  of  eggs  are  1a1d=^specl^^  to  survivp*  

Ifumale  fish  spawn  anywhere  from  500 ^o  7  ff^llllPn-fiSflS^ 
reCTgnasiflPon  the  specitjs 


ERLC 


#ri2:    REPRODUCTION  "IN  FISHES 


embed- 
dedness 


CONQEPT  A 


RELATION- 
SHIP" 


CONCEPT  B 


1 

1.  reproduction  in  fishes 
1.2 

1 

2.  gonads 
2.1 

1 

3.  gonads 
2.2 

1 

4.  lie  in  body  cavity 
2.22 

1 

5.  lie  in  body  cavity 
2.22 


1 


6.  gonads 
2.2 

7.,  opening 
2.22 

8.  gonads 
2.3 

9.  ovaries 
2.31  . 

10.  ovaries 
2.32 


11 


1 


produce  eggs 
2.322 

12.  ovaries 
2.32 

1 

13.  as  eggs  grow 
2.32& 

1 

14.  ovaries  swell 
2.3267 

1 

15.  ovaries 
2.32 


0  1     .  . 
PROP  involves  gonads 

1  •         1  , 

DEF  the  reproductive  organs 

of  the  fish 

1  *  '1 

PROP  lie  in  body  cavity 

1  1    •  ■ 

^ PROP  in  posterior  part  of 


1  ' 
'PROP 

1 

PROP 
1 

PROP 
0 

EXAMP 
1 

PROP 

1  . 
PROP 

■  1 

PROP 
1 

PROP 
0 

PREC 
0 

CAUS 
1 

PROP 


1 

above  digestive  organs 

"  1  . 
have  openings' 

1 

just  behind  anal  opening 

r    .  1  * 


ovaries 


1 


reproi^tive  organs  of  female 
fish    '"^   .        '  •  , 

I..- 

produce  eggs  -  - 

1  ' 

over  a  period  of  several  months 

1 

as  eggs  grow  then  ovaries  swel  1  (tl'13) 
causes  sides  of  fish  'to  bulge  (f/14) 
1 

ovaries  swell 

1      '  . 
sides  of  fish  may  bulge 


1 

paired  ovaries  may  fuse  into' 
a  single  Vary 


ERIC 


#112:    R'EPRODUGTION  IN  FISHES 

CONCEPT  A 


embed - 
dedness 


.RELATION- 
SHIP 


CONCEPT  B 


16. 

17. 

18. 

19. 
•20. 
21". 
22. 
23. 
24. 
25. 
26. 
27. 
28-. 
29. 


1 

paired  ovartes  may  fuse  into 
,a  single  ovary    ,  ' 
2.322  -  ■  . 

1 

paired  ovaries  may  fuse  into 
a  single  ovary  < 
2.322        •       ,  - 

'  1 

pajred  ovaries  may  fuse  into 

a  single'  ovary 

2.323 


1 

PROP 


1 

PROP 


1 


1 


gonads 
2.3 

testes 
2.31 

S 

testes 
2.32  . 


1 


reproduction  in  fishes 
1.2 

0 

reproductive  process 
3.2 

1  • 

exteriial  .fertilization 
3.22- 

^  .  1 
female*  spawns 
3.226 

1 

female  spawns 
3.221 

1 

male  swims  over  the  eggs 
3.2266 

1 

milt  * 
3.22661 

1 

male  discharges  milt 
3.22662 


0 

EXAMP 
1 

•DEF 
.  1 

PROP 
0 

PROP 
0 

PROP 
0 

PROP 

"o 

PREC 
1 

DEF 

0 

PREC 
1 

DEF 
1 

PROP 


during  embryonic  growth 

9 


1 


in  many  fish 
( 

1  1 
EXAMP     in  yel low  perch 


testes 


1 


sex  organs  of  male  fish 

.1. 

develop  sperm  cells 

'  0 

reproductive  process 


Rel.  Prop.  #24,32.40.41 


Rel.  Prop.  Ii'25,27.30,31 
1 

mal^  swims  over  the  eggs 
1 

lays  the  eggs 

-J- 

1        -1  '  - 

male  discharges  milt 

1 

a  fluid  containing  the  sperm 
1 

onto  the  eggs 


ERIC 


1 


#112:    REPRODUCTION  IN  FISHES 

M 

embed-  / 
#       dedness  CONCEPT  A 


SHIP 


CONCEPT  B 


.  ( 


1  0. 

ma-le  discharges  milt  PREC 
3.22666 

1     '             •  0  '  ^ 

sperm  swims  to  eggs  /f^ft 

3.22666  ^ 

t   •     •  0 

32.    external  fertilization  PR£C 
3.26 

1                   /  1 
■33.    fertilized  eggs  begin  to      "  PROP 
develop 

3.262                ■     ,  , 

.  .  1    .  1 

34.  develop  into  embryos  '  PROP. 
,3.2622                         "  ^ 

1  -  .    ,  1 

35.  may  take  from  a  couple  of  PROP 
days  to  many  weeks 

3.26222 

1  ■  1 

36.  may  take  from  a  couple  of  PROP 
days  to  many  weeks 

-     '3-.  26222 

1  .  1 

37.  develop  into  embryos  PROP 
3.2622 

1  1 

38.  yolk  DEF 
3.26221 

1       •  .  1 

39.  yolk  PROP 
3.26222     -  ^ 

1  0 

40.  fertilized  egg  begins  to  PREC 
develop 

3.266 

1  1 

41.  baby  fish  hatches  PREC 
3.2666 

1       •  1 

42.  yolk  sac  remains  attached  to  PROP 
baby  fish 

3.26662 

1  0 

43.  reproduction  irj  fishes  PROP' 
1.2 


1 

sperm  sw^^is  to  eggs 
1 

sperm  fertilizes  the  eggs 
1 

fertili'zed  eggs  begin  to 
develop 

1 

into  embryos 


1 

may  take  from  a  couple  of 
days  to  many  weeks  ^ 

1  ^ 
depends,  on  species 


1 

depends  on  water  temperature 


1  . 

nourished  by  yolk 

-  1 

large  amount  of  nonliving  material 
held  in  egg 
1 

special  food  in  the  egg 

'    '  1 
baby  fish  hatches 


1 

yolk  sac  remains  attached  to 
baby  fish 

1 

for  a  short  time 


1  y 
takes  place  under  harsh  con- 
ditions 


ERIC 


'138 


1^112:    REPRODUCTION  IN  FISHES 

CONCEPT  A 


embed- 

#  dedness 


RELATION- 
SHIP 


CONCEPT  B 


T 


44.  takes  pTace  under  harsh 
conditions 

4.3 

1 

45.  takes  place  under  harsh 
conditions 

4.3 

1 

46.  many  eggs  are  never 
fertilized 

4.37 

1 

47.  takes  place  under  harsh 
condi  tions 

4.3 

1 

48.  takes  place  under  harsh 
conditions 

4.3 

1 

49.  -takes  place  under  harsh 
conditions 

4.7' 

1 

50.  question:    how  does  a  fish 
species  continue  to  survive? 
4.72 

1 

'  51.    large  number  of  eggs  are 
laid 
4.727 

52.  large  number  of  ^ggs'are 
laid 

4.723 

53.  .  female  fish  spawns  anywhere 
.  from  500  to  7  million  eggs 


0 

EX  AMP 


T 


EX  AMP 


1 

CAUS 


0 

EXAMP 


0 

EXAMP 


0 

CAUS 


1 


spawningris  not  very 
efficient 

1 

many  eggs  are  never 
fertilized  causes  never 
develop 

1 

never  jievelop 


1 

many  eggs. are  eaten  before 
hatching  by  predators 

1  ^ 

baby  fish  may  be  eaten  by 
bigger  fish  and  other  water 
animals 

1 

question:    how  does  a  fish 
species  continue  to  survive? 

1 


PROP  ^  large  number  of  eggs  are  laid 
-    causes  species  to  survive  (51) 


1 

CAUS 


0 

EXAf^P 


1 

PROP 


1 

species  to  survive 


1 


female  fish  spawn  anywhere  from 
500  to  7  million  eggs 

1 

depends  upon  the  species 


#113  Systems  of  Classification  In  B1o]ogy 

Four  Kingdoms    .  . 

Notice  that  the  differences  between  plants  and  animals  are 
matters  of  degree.    Plants  are  complex,  responsive,  and  motile. 
Animals  are  more  so.    Animal  cells  have  some  strength  and  rigidity, 
but  plant  cells  have  even  more.    Plants  contain  some  salt,  but 
animals  contain  move  of  It.    It  seems  as  l-f  the  plant  and  animal 
kingdoms  should  overlap.    Indeed  they  dp. 

When  we  get  down  to  the  smaller  and  simpler  organisms.  It 
Is  often  hard  to  tell,  which  are  animals  and  which  are  plant.  For 
this  reason  many  biologists  recognize!  one  or  more^addlttonal 
kingdoms.    These  take  In  organisms  which  are  neither 'definitely  . 
plants  nor  definitely  animals. 

In  this  book  organisms  are  grouped  In  the  four  kingdoms  of 
monera,  protlsts,  plants,  and  animals.    Other  books  may  use 
slightly  different  classifications.    The  four  kingdoms  are  shown 
In  Plates  1-8,  and  are  discussed  In  the  three  remaining  chapters 
of  this  unit.-  • 

Systems  of  classification  are  useful  In  biology  because  they 
show  relationships  and  help  to  organize  Information.  Howe!\ter, 
they  are  human  creations,  not  unchangeable  natural  law.    None  Is 
•likely  to  satisfy  all  biologists.    The  organisms  carry  on  their 
life  functions  unchanged,  no  matter  how  biologists  may  classify 
them.  - 
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F1 aqel  1  ates 

The  flagellates  have  long  been  a  biological  battleground. 
Zoologists  claim  them  as  animals  and  place  them  with  the  protozoa. 
Botanists  regard  them  basically  as  plants  and  include  them  with  the 
algae     "  ^  ,  ' 

We  meet  this  situation  fay  calling  them  protists.    Yet  we 
recognize  that  some  are  indeed  plants,  some  are  animals,  and  still 
others  seem  to  belong  to  both  Icingdoms.  - 

Eufllena  illustrates  the  problem '{Fig.  6-lOA)..   This  protist 
is  abundant  in  poluted  water  and  in  quiet  ponds,  where  it  forms 
a  green  scum.    Eug.lena's  tolerance  of  low  pH  enables  it  to  live 
in  acid  sphagnum  bogs.    A  protective  cover  forms  when  conditions 
become  unfavorable. 

The  spindle-shaped  cell  has  two  flagel1§,  a  sensitive  eye- 
spot,  and  chloroplasts.  Although  related  to  the  green  alga^,  it 
stores  the  carbohydrate  paramylum  rather  than  starch. 

A  related  flagellate,  Khawkinia  (B),  is  similar  to  euglena 
but  lacks  chlorophyll .    If  euglena  is  kept  in  the  dark  or  is 
treated  with  streptornydin,  it  lose,s  its  chlorophyll.  Like 
khawkinia,  it  absorbs  food  from  the  water. 

•  ^  '  ■         .  ' 

In  another  flagellate  pair  (C  and  D),   Cryptomonas  is  green, 
Chilomonas  is  non-green.    Both  can  consume  prey  whole,  as  animals 
do.    In  this  welter  of  varied  flagellates,  where  do  we  draw  the 
line  between  plants  and  animals? 

Biologists  disagree  in  their  answers  to  the  last  (Question. 
Yet  they  are  almost  unanimous  in  accepting  the  evidence  that  most 
higher  organisms, evolved  from  flagellates.    Some  flagellates  at 
times  lose  their  flagel la  and  move  by  means  of  flowing  protoplasm, 
like  the  ameba,  a  protozoan.    The  f 1 aqel  1  ate' Protospongi a  closely 
resembles  the  collar  cells  of  sponges.   These  resemblances  se?m 
to  show  relationship. 
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#115  Linnaean  System 

(no  heading) 

The  Cinnaean  system  uses  binomial  classification.  Each 
species  has  a  unique  name  based  on  Its  genus  and  its  species,  for 
example  Equus  cabal  1  us.    The  name  is  always  in  Latin. 

The  scientist  who  first  Identifies  a  new  species  has  the 
right  to  name  It,  provided  a  description  Is  published. in  a 
recognized  journal.   An  original  specimen  must  alse  deposited 
In  some  collection  where  others  can  study  It. 


y  The  rules  are* made  by  International  congresses.  Blologi 
sincerely  try  to  ob6y  them. 


sts 


.  We  still  use  Linnaeus'  basic  system,  though  we  1oo|c  at  the 
system  differently.    Linnaeus  believed  that  specije?  were  fixed 
and  unchanging.    We  now  believe  that  species  change  and  evolve. 

Thus  no  species  lasts  forever.    Eventually  It  disappears. 
Either  It  becomes  extinct,  or  It  changes  Into  one  or  more  new 
species.    Since  the  change  Is  gradual.  It  is  often  hard  to  decide 
when  a  species  has  split  up. 

Biologists  often  disagree  as  to  whether  groups  or  organisms 
have  drifted  far  enough  apart  to  be  called  separate  species,  or 
whether  they  still  belong  together. 

Another  difference  Is  that  Linnaeus  .placed  all  horses  In  the 
same  species  because  they  are  similar.    We  now  emphasize  that  all 
horses  are  similar  only  because  they  had  a  common  ancestor. 
Horses,  donkeys,  and  zebras  are  grouped  In  the  family  Equldae 
because  they  descended  from  the  same  even^more  remote  ancestors. 

Finally,  to  Linnaeus  a  species  was  represented  by  the  type 
specimen  deposited  In  a  museum.    Variations  from  the  type  were 
regarded  almost  as  nuisances.    We  now  stress  that  a  species  Is 
a  population  which  always  shows  considerable  nat;ura1  variation. 
Horses  do  not  have  to  be  exactly  alike  to  foi^m  a  valid  species. 
"  < 
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#116  Protozoa 


Kinds  of  Protozoa 

There  are  three  main  groups  of  protozoa.    We  have  discussed 
the  sarcodines  and  the  ciliates.    Sporozoans,  the  third  group  are 
all  parasites.  Malaria  is  one  of  the  diseases  caused  by  members 
of  this  group.    We  may  call  these  groups  classes,  though  some 
biologists  prefer  to  classify  the  three  groups  as  separate  phyla 
of  protists. 

Why  are  the  protozoa  called  animals?   They  voraciously 
Consume  their  food  in  chunks.    They  are  active  and  responsive. 
They  lack  cell  walls.   They  divide  like  animal  cells.    In  short, 
they  are  true  little  animals. 

Although  the  term  protozoa  means  first  animals  this  name  is 
poorly  chosen.    Protozoa  are  so  complex  that  they  have  unquestion- 
ably evolved  very  far  from  their  first  animal -like  ancestors. 
Their  intricate  calls  often  have  cell  mouths,  as  we  have  seen  in 
Paramecium. 

Digestive,  excretbry,  nervous,  and  other*  specialized  structures 
may  be  present.    These  protozoan  structures  are  enclosed jwithin  a 
single  cell  membrane.    Henc6  they  are  not  true  metazoan  organs  but 
are  orgenelles. 

Protozoah  complexity  is  also  shown  in  the  9+2  structure  of 
their  cilia  and  flagella,  and  in  their  rodlike  chromosbmes— more 
advanced  than  the  single,  circular  chromosome  found  in  bacteria* 
It  is  unlikely  that  a  specialized  creature  such  as  ameba  is  the 
(SHrtfct  ancestor  of  human  beings,  though  this  misconception  is 
popular. 
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#217  Chief  Arguments  For  and  Against  Slavery 
For  and  Against  Slavery 

Mai  achy  Postlethwayt  and  Thomas  Paine  had  presented  the  chief 
arguments  for  and  against  slavery.    The  arguments  did  not  change 
much  in  the  next  hundred  years.   Those  who  defended  slavery  spoke 
of  the  money  it  could  make  for  the  slaveowners.    They  said  that 
there  was  no  other  way  to  work  the  farms  and  plantations  of  the 
South.    They  insisted  that  slaves  were  property,  and  that  no  map 
could  take  away  another's  property.    Their  slaves,  they  said, 
were  better  off  than  they  had  been  in  Africa.    Finally,  they  turned 
to  religiorj.    Were  they  not  making  Christians  of  their  slaves?  The 
souls  of  these Jaiflck  men,   women  and  children  would  be i saved  no 
matter  what  hailed  to  their  bodies  on  earth.  < 


The  attack  against  slavery  followed  the  ideas  of  such  men 
as  Thomas  Paine.    No  man  had  the  right  to  own  another  man.  It 
was  evil  to  make  money  from  slavery.  ♦It  was  wrong  to  say  that  a 
slave  was  just  another  kind  of  property.    No  human  being  could  be 
property.    It  mattered  little  how  well  a  master  treated  his  slave. 
The  slave  still  had  a  right  to  his  freedom,  as  all  men  do.  And 
talk  of  helping  slaves  by  making  them  Christians  was  nonsense. 
What  Christian  would  try  to  save  a  soul  by  destroying,  a  life? 
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#218  Why  Blapks  Had  Little  Hope„in  1857 

A  Time  of  Despair  "  ^ 

In  1857  black  Aireri  cans  "had  little  hope.    Slavery  was' 
stronger  than  ever  In  the  ^uth.    There  was  little  equility  in  the 
North.    In  most  places  wht^  people  could  not  foVget  that  each 
forget  that  each  freedman  had  orice  been  a  slave.    Most  white  people 
could  not  rid  themselves  of  the  feeling  that  any  white  person  was 
somehow  betteh  than  any  black.   There  were  few  places  where  a 
black  man  could  hope  to  vote,  find  a  good  job  or  give  his  children 
an  education  equal  to  that  received  by  white  boys  and  girls. 

<  — 

Life  was  worse  in  the  South.    The  slaveowners  who  ruled 
there  used  their  power  to  makecertain  that  black  people  were  never 
given  equal  rights.    Meanwhile,  the  United  States  was  growing.  New 
states  ^ere  fo»*ming  in  the  West.    Southern  leaders,  helped  by  many 
politicians  in  the  North,' worked  to  spread  slavery  to  these  new 
states.    Stephen  Douglas,  Senator  from  Illinois,  said  slavery 
should  be  allowed  in  any  new  state  whose  white  citizens  wanted  it! 
In  1854  Congress  had  passed  the  Kansas-Nebraska  Act,  which  seemed 
to  open  a  great  new  area  to  slavery.    The  whole  country  was  waiting 
for  the  Supreme  Court's  decision  in  the  D red  Scott  case.  It  would 
decide  many  questions  at  the  same  time.  .  , 
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#219  Western  Cattle  Industry  in  1980 's 

Ranches  and  fences 

By  the  1980's  the  western  cattle  industry  centered  in  the 
high  plains  running  through  eastern  Montana,  Wyoming,  Colorado, 
the  New  Mexico  Territory,  and  western- Texas.   Most  ranchers  by 
now  owned  their  grazing  land  and  fenced  it  in  with  barbed  wire. 

Ranches  varied  in  size  from  about  2,000  to  100,000  acres 
(about  800  to  40,500  hectares).    To  an  easterner,  accustomed  to 
small  farms  of  a  few  hundred  acres  at  most,  western  ranches  seemed 
enormous.    But  the  ranches  had  to  be  large  since  each  steer  required 
a  grazing  area  of  15  to  75  acres  (or  about  6  to  30  hectares), 
depending  upon  the  amount  of  rainfall  and  the  resulting  growth  of 
grass. 

With  the  invention  of  better  instruments  for  drilling  into 
the  ground  and  the  improvement  of  windmills  for  pumping  water, 
many  cattle  raisers  watered  their  stock  from  wells  scattered  over 
their  ranches.    In  years  of  abundant  rainfal 1 ,  cattle  ranches  might 
prosper,  since  their  herds  could  fatten  on  the  natural  grasses. 
But  in  years  of  drought  they  were  forced  to  feed  their  cattle  hay 
or  cottonseed  cake,  a  costly  practice  which  often  wiped  out  their 
profits. 
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#220  Sherman  Antitrust  Act 
The  Sherman  Antitrust  Act 

Finally,  In  1890,  during  the  administration  of  President 
Benjamin  Harrison,  Congress  passed  th*  Sherman  Antitrust  Act. 
The  public  assumed  that  the  act  was  Intended  to  restore  a  larger 
measure  of  free  competition  l?y  breaking  up  giant  "trusts"— a  term  ^ 
that  had  come  to  mean  any  monopoly  or  near-monopoly  of  an  industry. 
This  also  seemed  to  be  what  Congress  Intended,  for  Section  1  of 
the  act  declared:    "Every  contract,  combination  in  the  form  of 
trust  or  otherwise,  a  conspiracy,  in  restraint  of  trade  or  commerce 
among  the  several  states  or  with  fore-ign  nations  is  hereby 
decl aired  to  be  Illegal  ..."   The  act  further  stated  that 
individuals  and  corporations  found  guilty  of  violating  the  law 
,)K/ould  be  liable  to  legal  penalties. 

Weakness  of  the  Sherman  Antitrust  Act 

Actufilly,  few  Americans,  Including  even  corporation  lawyers 
and  members  of  Congress,  understood  precisely  what  the  new  law  did 
and  did  not  prohibit.    The  act  failed  to  define  such  words  as 
"trust,"  "combination,"  "conspiracy,"  and  "monopoly." 

Because  of  its  loose  wording,  the  Sherman  Antitrust^  Act  was 
extremely  difficulty  to  enforce.    The  government  lost  seven  out  of 
the  first  eight  cases  that  it  brought  against  giant  business 
combinations,  or  trusts.  ^ 

In  1395,  the  Supreme  Court  handed  down  a  decision  in  the 
case  of  U.S.  v.  E.C.  Knight  Company  that  made  the  antitrust  law 
almost  meaningless.    The  Count  ruled  that  the  company,  which  had 
secured  control"  of  98  percent  of  the  sugafr  refining  business,  was 
not  guilt  of  violating  the-  antitrust  law  because  its  control  of 
the  refining  process  alone  did  not  Involve  restraint  of  Interstate 
trade.    A  monopoly  Itself  was  not  Illegal,  the  Court  stated.  It 
became  Illegal  o^ly  when  Unserved  to  restrain  Interstate  trade.  ' 
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Corporations  •  ^  -  v 

As  Indus tries, grew  larger  in  the  ISOO's,  another  form  of  '  , 
business  organization,  the  corporation,  tjecame  more  common.    It  , 
gradually  became  the  leading' form  of  business  organization  in  the 
United  States.'  «  x     -  ' 

To  start  a  corporation,  three  or  irtore  persons  must  apply  to 
a 'state 'legislature  for  a  charter,,  or  license,  to/start  a  specific 
business  enterprise.    Once  granted,  this  charter  allows  the  ,  - 

interested  persons  to  organize' a  corporation  and  sell  shares  of     -  - 
stock,  or  certificates  of  flwogrship,  to  r?iise  the  capital,  needed 
to  carry  oh  the  enterprise.    The  stockholders  or  shareholtfers— 
those  who  invest  their  money  in  the  enterprise—may  periodically 
receive  dividends,  that  is ,  a,  share,  of  the  corporation's  profits.  • 
Legally,  a  corporation  is  regarded  as  an  individual— an  "artificial 
.'  person"  'entirely  separate  from  its  owners— possessing  certain  rights, 
such  as  the  right  to  make  contracts,  to  buy  and  sell  property,  and 
to  sue  and  be  sued  in  court.  -  ■  .  ' 

The  corporation  has  important  advantages  over  the  individual 
proprietorship  and  the  partnership.  ,Jw6  advantages  are  especially 
important  to  th,e  corporation  itself:    First,  the  qorporation  can . 
draw  upon  very  large  supplies  of  capital  because  it  can  s^ll  shares- 
of  stock  to- many  people.    Second,  the  charter  gives  the  corporation 
"perpetual  life";  that  is,  the  corporation  is  not  ended  by  the 
death  or  re?ignation  of  one  or  several  of  its  owners. 
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#222  John  D.  Rockefeller 

John  D.  Rockefeller  _  »  v 

Even  richer  than  Carnegie  was  John  D'.  Rockefeller,  born  In  ' 
1839,  who  started  life  as  a  poor  boy  and  accumulated  the  world's 
greatest  fortune.  One  of  five  children.  Rockefeller  left  high 
'school  after  one  year  to  work  as  a,  clerk  for  about  $3  a  week.  In 
•^1858,  at  age  19,  he  went  Into  the  wholesale  food  business.    The  , 
Civil  War  brought  large  profits  to  the  new  cdjhpany.   Rockefeller  ; 
promptly  invested  his  money  in  oil  refineries,  and  from  this  point 
on  oil  became  his  major  interest.    He  pioneered  in  developing  the 
trust  as  a  form  of  big  business  organization.*  Although  ruth 1qs|i 
in  forcing  competitors  to  choose  between  joining  him  or  going  f 
down  in  ruin.  Rockefeller  is  credited  with  bringing  order  and 
efficiency  to  the  highly" chaotic  and  wasteful  oil  Industry.  ■ 

By  1900,  however.  Rockefeller's  Interests  had  broadened.  , 
He  owned  Controlling  stock  in  the  gigantic  Standard  Oil  Company, 
in  railway  lines.  In  steamship  lines,  in  iron  ore  deposits  in  ^ 
Colorado  and  in  the, Lake  Superior  region,  in  steel  mills,  and  in 
many  other  enterprises.    When  the  United  States  Steel  Corporation 
was  being  organzied  by  J. P.  Morgan,  Rockefeller  sold  to  the  newly 
formed  corporation  his  iron  ore  -deposits  and  Great  Lakes  steamers, 
receiving  $80  million  for  the  iron  ore  deposits  alone. 

•  Like  Carnegie,  Rockerfeller  later  gave  away  many  millions, 
and  the  foundations  created  with- his  money  today  continue  to 
foster  research  and  promote  the  welfare  of  the  American  people. 
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#223  The  New  Deal  Farm  Program 

Dust  Bowl 

The  'new  deal  had  to  cope  with  a  terrible  disaster  that  struck 
the  Great  Plains  In  1934  and  1935.    During  World  War  I,  prices  had 
tempted  fanners  to  grow  wheat  and  cotton  In  the  former  grazing 
lands  west  of  98"  longitude.    Plows  and  harrows  broke  up  the _deep, 
tough  sod  that  had  previously  prevented  erosion  and  conserved 
molstur'e  In  this  semi-arid  region.    When  the  years  1933-1935  proved 
unusually  dry,  there  was  danger  that  the  region  would  become  a 
desert;   Terrible  dust  storms  carried  away  topsoll  In  such 
quantities  that  even  on  the  Atlantic  seaboard  the  sun  was  obscured 
by  a  yellow  haze.    The  water  table  of  paVts  of  the  Plains  region 
sank  so  low-that  deep  wells  ran  dry.    Between  1934  arytl  1939  an 
estimated  350,000  fanners  emigrated  from  the  "dust  bowl."    To  take 
care  of  inmediat^  l^stresOlongress  provided  funds  so-that  dust 
bowl  farmers  could  geVftew  seed  and  livestock.    On  a  long-term 
basis,  the  Department  of  Agriculture  d^ifTT^itK  the  dust  bowl  by 
helping  farmers  to  plant  190  ml  1 1 1  oivtrees  Jn  shelter  belts,  which 
cut  wind  velocity  and  retained  moisture.    Farmers  were  also 
encouraged  to. restore  the  Plains  to  what  they  had  been  In  the  days 
of  the  cattle  kingdom  and  earlier  a  grazing  region.    ^  ^ 

There  was  much  crlticlsJof  the  New  Deal  farm  program.  ,Many 
fanners  did  not  like  being  told  how  much  they  could  plant. 
Dellverately  creating  scarcity  when  people  were  hungry  seemed 
inmoral.    The  benefits  of  the  AAA  were  unequal.    On  the  whole, 
though,  the  New  Deal  provided  more  direct  assistance  to  farmers 
than  to  any  other  group  in  the  population.    Hundreds  of  thousands 
of  families  were  saved  from  bleak  pbverty  and  despair. 
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During  the  first  phase  of  the  Roosevelt  administration, 
1933  to  early  1935,  the  dominant  purposes  were  recovery  and  relief. 
During  this  period,  the  President  and  his  advisers  had  the  idea 
that  through  a  series  of  temporary  expedients  they  could  get  the 
econonv  into  high  gear  again,  and  then  let  it  carry  on  by  its  own 
momentum.    This  "first  New  Deal"  was  therefore  not  much  different 
in  purpose  and  philosophy  from  Hoover's  efforts  to  stem  the 
depression.    During  this  early  period,  too,, Roosevelt  resembled 
Hoover  in  seeking  the  support  of  the    business  community.    He  spoke 
of  an  alliance  of  "business  and  banking,  argiculture  and  industry, 
and  labor vand  capital."    His  purpose  throughout  his  entire 
presidencyNwas  to  save'the  capitalist  system.    The  difference  from 
the  previous  administration  was  in  the  magnitude  and  variety  or 
legislation  and  in  a  much  greater  willingness  to  call  on  the  full 
powers  qf  the  federal  government. 

Although  opponents  charged  that  the  New  Deal  was  inspired 
by  alien  "isms,"  its  origins  were  mostly  to  be- found  in  earlier 
American  protest  movements,  such  as  those  of  the  Populists  and 
the  progressives.    FDR  put  into  effect  several  lieasures  first 
proposed  by  Teddy  Boosevelt.    New  Deal  laws  dealing  with  banking, 
the  tariff,  and  child  labor  were  further  developments  of  legis- 
lation passed  under  Woodrow  Wilson.    The  New  Deal  was,  howeyer,  so 
much  We  far-reading  than  anything  achieved  or  proposed  by 
Theodore  Roosevelt  or  Wilson  that  it  had  the  aspects  of  a  revolution- 
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#225  First  Phase  of  the  New  Deal 
First  Phase  of  the  New  Deal :    "Try  Something" 

Roosevelt  came  into  office  with  no  very  clear  idea  of  how  he 
was  going  to  deal  with  the  economic  crisis.    This  did  not  dismay 
him.    "There  is  nothing  to'  do,"  he  said,  "but  meet  each  day  s 
troubles  as  they  come."    Some  laws  were  passed  against  the 
President's  wishes,  but  he  signed  them  to  head  off  something  he 
Jiked  even' less,  or  to  avoid  holding  up  other  legislation.  His 
principal  contribution  to  the  New  Deal,  in  addition  to  dynamic 
leadership  and  political  skill,  was  his  "try  something"  philosophy. 
He  likened  himself  to  a  quarterback  on  a  football  team  who  calls 
plays,  and  if  one  does  not  work.. tries  another.    In  any  case,  he 
felt,  actipn  was  better  than  inaction. 

The  New  Deal  was  thus" no  carefully  worked  out  program,  like 
that  of  Alexander  Hamilton  in  the  Washington  administration,  or 
that  proposed  by  Woodrow  Wilsom  when  he  took  office  in  1913. 
Instead,  it  reflected  tk  haste  which  went  with  trying  to  attack 
the  depression^ on  many  fronts  at  once.    It  reflected  the  special 
demands  of  pressure  groups.    Some  New  Deal  measures  would  have 
been  enacted  sooner  or  later  in  any  case,  because  they  embodied 
longstanding  demands  for  change.    Thus  Congress  repealed  the 
Volstead  Act  and  permitted  the  sale  of  light  wines  and  beer.  In 
December  1933  c4me  the  Twenty-first  Amendment,  which  repealed  the 
Prohibition  amendment  once  and  for  all'. 
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#226  The  American  Econon\y  Was  Close  to  Rock  Bottom 
Rocki-  Bottom  ;  . 

By  summer  of  1932  the  American  economy  was  close  to  rock 
bottom.    National  income  had  dropped  from  $81,000,000,000  to 
$41,000,000,000.    The  steal  industry  was  working  at^22  per  cent  » 
of  capacity.    Thousands  of  business  concerns  had  gone  into  bank- 
ruptcy and  thousands  of  banks  had  closed  their  doors.    A  quarter 
of  a  third  of  the  industrial  laborers  of  the  country  were 
unemployed  and  many  others  worked  only  part  time.    In  every  large 
city  there  were  bread  lines",  soup  kitchens,  people  selling  apples 
on  street  corners,  and  people  so  hungry  they  raided  garbage  cans. 
A  popular  song,  "Brother,  Can  You  Spare  a  Dime?"  reflected  the 
frequency  of  begging.    Local  governments,  faced  by  dwindling  tax 
receipts  and  mounting  relief  costs,  were  so  near  bankruptcy  that 
fire  fighters,  police,  and  schoolteachers  sometimes  went  unpaid 
for  mijnths  at  a  time. 

The  depression  was  uneven  in  its  impact,    l^-^erwd    to  have 
the  harshest  effects  on  those  who  could  least  b^r  irr  Thus  the 
wages  paid  industrial  workers,  and  the  income'^recei ved  by  farmers 
fell  more  rapidly  than  dividends  and  interests  from  stocks  and 
bonds.    Those  with  fixed  incomes,  such  as  cell  lege  professors,  were 
actually  better  off  because  prices  declined.V  Although  the  bottom 
dropped  out  of  the  new  car  market,  enough  p«o)>lemanaged  to  hold 
on  to  their  old  ones  so  that  the  use  of^gasoline^xlid  not  decrease. 
Cigarette  sales  rose  steadly. 
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#227  Effects  on  MUTIons  of  Young  Americans 
Work  for  Youth  ^ 

Perhaps  the  greatest  tragedy  of  the  depression  was  Its  effect 
upon  millions  of  young  Americans.    Many  were  forced  to  leave  school 
or^Cjpllege  because  they  lacked  food  and  clothing  or  were  homeless. 
^Those,  who  graduated  dur1ny«Mie  depression  years  faced  unemployment. 
Thousands  of  jobless  young  Americans  roamed  the  nation  In  search 
of  work. 

Two  agencies  were  created  to  bring  Inmedlate  work  relljsf  to 
the  nation's  youth.    In  1933  the  Civilian  Conservation  Corps  (CCC) 
was  organized.    At  times  as  many  as  500,000  young  men  between  18 
^nd  25  were  enrolled  In  the  CCC.    Mearly  all  of  them  were  unmarried; 
most  came  from  pav6rty-str1cken  families.    These  youths  lived  In 
work  camps  scattered  across,  the  land.    They  received  food,  clothing, 
and  shelter;  they  were  paid  wages  which  they  were  expected  to  share 
with  their  families;  and  they  were  offered  opportunities  for 
recreation  and  education* 

The  young  Americans  In  thelCCC  did  socially  useful  work. 
They  build  fire  trails  Irt  the  forest,  cleared  swamps,  planted  trees, 
built  small  dams  for  flood/control ,  cleared  land  for  public  parks, 
and  In  other  ways  helped  to  conserv%/the  nat1on*s  natural  resources. 

A  second  New  Deal  work  r^Hef  measure  aided  young  people 
Still  1?!  school.    The  Nfft4<maT  Youth  Administration  (NYA),  created 
In  193d,  distributed  federal  money  to  needy  students,  who  were 
paid  regular  wages  for  performing  tasks  In  and  around  their  school. 
During  Its  first  year  the  NYA  gave  Jobs  to  more  than  400,090 
students.  '  ^ 

The  New  Deal  youth  program  saved  hundreds  of  thousands  of 
youths  from  Idleness,  helped  them  to  maintain  their  self-respect, 
and  enabled  many  to  get  an  education.    It  also  kept  many  young 
Americans  out  of  the  overcrowded  job  market  In  business  and 
Industry. 
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President  Frank! i a  Delano  Roosevelt  took  office  on  March  4, 
1933,  In  the  midst  of  the  Great  Depression.  iHe  began  his  adminis- 
tration with  a  ringing  call  to  the  American  people  to  face  the 
future  with  courage  and  faith.    "The  only  thing  we  have  to  fear 
is  fear  itself,"  he  condifently  stated.    His  calm  words  helped  to 
lift  the  nation  from  its  despair  and  helped  to  rally  the  people 
behind  the  government. 

The  President  outlined  his  New  Deal  program  in  a  crisp, 
dramatic  Inaugural  Address.    He  them  presented  his  reform  proposals, 
with  recommendations  for  immediate  action,  to  a  special  session  of 
Congress  that  he  called  soon  after  taking  office. 

The  New  Deal  had  in  general  three  aims—relief,  recovery, 
and  reform.    Because  Americans  were  clamoring  for  action,  the 
three  aims  were  often  mixed  together  as  objectives  of  a  single  act 
of  Congress.    Sometimes  measures  adopted  to  realize  one  of  the,j 
aims  interfered  with  other  measures  designed  to  achieve  the  other 
aims. 

,  But  for  easier  analysis,  it  is  convenient  to  divide  the  New 
Deal  into  its  three  essential  parts:  (1)  measures  to  provide  relief 
for  the  unemployed;  (2)  measures  to  speed  the  recovery  of  agricul- 
ture, industry,  commerce,  and  labor;  and  (3)  measures  to  remedy 
certain  weaknesses  in  trie  economic  system. 

Such  was  the  general  nature  of  the  Great  Experiment  that 
President  Roosevelt  and  Congress  launched  in  the  Spring  of  1933. 
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l!l229  Roosevelt's  Financial  Policies 
Roosevelt's  financial  policies  opposed 

Much  of  the  opposition  to  the  New  Deal  came  from  people  who 
believed  that  Roosevelt's  financial  policies  were  undermining  the 
nation's  economic  system.    With  the  return  of  better  times  this 
group  became  larger  and  more  outspoken. 

The  New  Dealers *used  three  different  methods  for  financing 
their  relief,  recovery,  and  reform  programs. 

One  method  was  inflation.    Although  Congress  authorized 
President  Roosevelt  to  print  paper  money,  he  never  iKd  so.  He 
did,  however,  decrease  the  gold  content  of  the  donar. 

A  second  method  was  deficit  spending.    This  meant  that  the 
government  spent  more  than  it  received  in  taxes,  leaving  the 
budget  unbalanced,  or  showing  a  deficit.    In  the  1930's  the  national 
debt  increased  from  about  $16  billion  to  more  than  $40  billion. 
Men  and  women  in  both  parties  were  highly  critical  of  the  failure 
of  the  Roosevelt  administration  to  balance  the  budget.  Business 
leaders  in  particular  lost  confidence  in  an  administration  that 
piled  up  a  larger  and  larger  national  debt. 

Another  method  by  which  the  New  Deal  had  financed  its 
operations  was  by  raising  taxes.    In  1935  the  administration  asked 
Congress  to  increase  taxes  on  corporations  and  to  levy  taxes  on 
gifts  and  inheritances.    Critic^Vlled  this  a  "soak  the  rich" 
proposal  because  it  put  a  new  tax  burden  upon  the  well-to-do. 
Despite  strong  opposition,  however.  Congress  passed  the  Revenue 
Act  of  1935,  often  called  the  Wea;th  Tax, Act.    With  this  measure 
Congress  increased  the  income  tax  for  individuals  and  large 
corporations  and  levied  taxes  on  gifts  and  estates.    But  thej^ 
revenue  thus  obtained  did  not  balance  the  budget,  and  the  national 
debt  continued  to  grow. 
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#229: 

embed- 

J      dedaeg^)     CONCEPT  A 


^ 


RELATION- 
SHIP^ 


CONCEPT  B 


1^         ^  I) 

55.  taxes  (Increased  income  CAUS 
taxes  and  levied  taxes) 
5.2277627 

1  -  1 

56.  obtained  revenue 
5.22776275 

1  „  0 

57.  .did  not  balance  the  budget  CAUS 
5.227762757 


obtained  revenue 


1 


NOT  SIM     did  not  balance  the  budget 


1 

national  debt  continued  to 
grow 


ERIC 
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#230  The  Natioanl  Industry  Recovery  Act 

The  NIRA  \  ■ 

The  Natioanl  Industri a V  Recovery  Act  went  into  effect  in 
June  1933  as  a  two-year  emergency  measure.    It  was  intended  to  I 
revive  industry  by  enabling  American  employers  tS  cooperate  in  / 
a  great  planned  effort  to  find  employment  for  jobless  workers  and 
to  raise  wages.    Cooperation  was  to  replace  competition  as  one  of 
the  major  driving  forces  of  American  industry.    Antitrust  legis- 
lation, such  as  the  Sherman  and  Clayton  antitrust  acts,  was 
disregarded.    Instead  the  government  officially  encouraged 
businesses  to  end  competition  and  form  cooperative  trade  associations. 

Tt»e  NIRA  provided  that  each  industry  should,  with  the  aid  of 
the  National  Recovery  Administration  (NRA),  adopt  a  "code  of  fair 
practices."   Once  these  codes  had  been  approved  by  the  President, 
they  became  binding  upon  the  entire  industry. 

Under  the  vigorous  leadership  of  General  Hugh  S.  Johnson, 
administrative  head  of  the  NRA,  some  95  percent  of  American 
industries  adopted  fair  practice  codes  within  a'^fetTrUQnths.  The 
codes  differed  a  great  deal.    But  in  general  they  limited  production 
and  provided  for  the  common  control  of  prices  and  smiles  practices. 
Most  codes  also  outlawed  child  labor  and  required  that  adults  not 
work  more  than  40  hours  a  week  and  that  wages  not  be  less  than  $12 
to  $15  a  week. 


7 


I 


6*03 


#230-THE  MATIGflAL  INDUSTRIAL  RECOVERY  ACT  (NIRA) 


went  fnto  effect  In  June  1933 


was  an  emergency  measure 

 T 


a  two-year  measure 


Intended  to  revive  Industi^y 

"7  cooperation  was  to  replace  competition 


as  one  of  major  driving  forces  of  American  Industry 


enable  American  employers  to  cooperate'ln  a  great  planned  effort 

to  find  employment  for 

Ito  raise  wages  | 

antitrust  legislation 
1  Sherman  Antitrust  Act  1 

(Instead) 

government^ officially  en- 

f Clayton  Antitrust  Act  1 

government  offlclally^en- 
couraged  business  to  form 
cooperative  trade  assoclatlors 

was  disrenarded 

provided  that  each  Industry  should 
adopt  a  "code  of  fair  practices" 


with  the  aid  of  the  National  Recovery 
Administration 


(NRA) 


codes  differed 
a  great  deal 


In  general  (most 
codes)  were  s1m< 
liar 

limUed  

production 


conmon  control 
or  prices  and 
sales  practlcfes 


outlawed  chIM 


required  adu 
not  to  work 
more  than  40 
hrs.  per  wk. 


Is 


wages  not  to 
be  less  than 
$12-15  per  w» 


approved 
by 

president 


codes  be- 
came bind- 
ing on 
whole  In- 
dustry  


(within  a 
few  months i 


9Stof  American 
Industries  adopt 
ed  fair  practice* 
codes 


=1 


nder  General 
n  S.  Jonnsor 


fe^Sers^lp 
admlnlstra- 
tlve  head 


#230:  NIRA 


embed - 
dedness 


CONCEPT  A 


RELATION- 
.SHIP 


CONCEPT  B 


1  

1.  NIRA, 
1.2/ 

2.  NI^A 


1  • 


1 


T 

PROP 
1 

PROP 
1 

PROP- 


3.  was  an  emergency  measure 
1.22 

1  1 

4.  NIRA  ,  PROP 
1.2 

1  0 

5.  intended  to  revive  industry  PROP 
2.2 

1  1 

6.  cooperation  was  to  replace  PROP"^ 
competi  tion 

2.22 

1  0 

7.  intended  to  revive  industry  EXAMP 
2.3 

1  0 

8.  enable  American  employers  to  EXAMP 
cooperate  in  a  great  planned 
effort 

2.33 

9.  enable    American  employers  to  EXAMP 
cooperate  in  a  great  planned 
effort 

2.33 

1  0 

10.  intended  to  revive  industry  EXAMP 
2.3 

1  1 

11.  Antitrust  legislation  NOT  SIM 
2.35                                  '  * 

1  1 

12.  Antitrust  legislation  NOT  SIM 
2.35 

1  1 

13.  Antitrust  legislation  EXAMP 
2.33 


1 

went  into  effect  in  June  1933 
1 

was  an  emergency  measure 
1 

a  2-year  measure 

1  * 

intended  to  revive  industry 
1 

cooperation  was  to  replace  com- 
petition 

1 

one  of  major  driving  forces  of 
American  Industry 

1 

enable  American  employers  to  cooper 
ate  in  a  great  planned  effort. 
1 

to  find  employment  for  jobless 
workers 


1 

to  raise  wages 


1 

Rel.  Prop.  #11,  12 
1 

government  officially  encouraged 
business  to  end  competition 

•1 

government  officially  encouraged 
business  to  form  cooperative  trade 
associations 
1 

Sherman  Antitrust  Act 


? 


#230:.  NIRA 


embed- 
dedness 


CONCEPT  A 


RELATION- 
SHIP 


CONCEPT  B 


1  

14.  Antitrust  legislation 
2.33 

1  * 

15.  Antitrust  legislation 
2.32 

1 

16.  NIRA 
1.2 


1 


T 
EXAMP 

1 

PROP 
1 

PROP 


1 


17.  provided  that  each  industry  PROP 
should  adopt  a  "code  of  fair 
practices" 

3.2 

1  1 

18.  provided  each  industry  sf|puld  PROP 
adopt  a  code  of  fair  practices 
3.2 

1  1 

19.  provided  each  industry  should  PROP 
adopt  a  code  of  fair  practices 
3.2 

1  1 

20.  codes  differed  a  great  deal  NOT  SIM 
3.25 

0  0 

21.  most  codes  were  similar  EXAMP 
3.23 

0  0 

22.  most  codes  were  similar  EXAMP 
3.23 

0  0 

23.  most  codes  were  similar  EXAMP 
3.23 

•    0  0 
24'.    jiiost  codes  were  similar  EXAMP 
3.23 

Ow'  0  0 

25.  most  codes  were  similar  EXAMP 
3.23 

1  0 

26.  provided  that  each  industry  PREC 
should  adopt  a  "code  of  fair 
practices" 

3.26 


1 

Clayton  Antitrust  Act 

1 

was  disregarded 
1 

provided  that  each  industry 
should  adopt  a  "code  of 
fair  practices" 
1 

with  the  aid  of  the  National 
Recovery  Administration 
(NRA) 

1 

codes  differed  a  great  deal 


in  general  (most  codes)  were 
similar 


in  general  (most  codes)  were 
similar 

1 

limited  production 
V 

common  control  of  prices  and  sales 
practices 

1 

outlawed  child  labor 

required  adults  not  to  work  more  than 
40  hours  per  week 
1 

wages  ndt  to  be  less  than  $12  to  $15 
a  week 

1 

approved  by  President  , 


ERIC 
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/ 


#230:  NIRA 

embed- 
#  dedness 


CONCEPT  A 


RELATION- 
SHIP 


CONCEPT  B 


1  1 

27.  approved  by  President  PREC 
3.266 

1  1 

28.  codes  became  binding  on  PREC 
whole  industry 

3.2666 

1  1 

29.  95%  of  American  industry  PROP 
adopted  fair  practices  codes 
3.266622 

1  1 

30.  General  Hugh  S.  Johnson  PROP 
3.266622 

1  1 

31.  General  Hugh  S.  Johnson  PROP 
3.266622 


1 

codes  became  binding  on 
whole  industry 
1 

95%  of  American  industries 
adopted  fair  practices  codes 

1 

under  General  Hugh  S.  Johnson 


1 

vigorous  leadership 
1 

administrative  head  of  NRA 


ERIC 


APPENDIX  E: 

EXAMPLES  OF  THE  SCORING  AND  RATIONALE  FOR  SCORING 
OF  TWO  FREE  RECALL  PROTOCOLS 


\  ■ 


a  08 


Annotated  Recall 

-  * 

^There  are  three  main  groups  of  one-  Subject  §  =  075 

celled  organisms.    ^Sporozoans  are  dealt  with 
In  this  section.    'These  are  types  of  protozoa, 
and     '*although many  xxx  people  believe  they 
are  related  to  humans,    ^they  are  not. 


Relation- 

Score 

Phrase  It 

Rationale 

ship 

comes  from 

1 .0 

A 

1  &  3  "protozoa" 

When  you  first  score  Phrase  1, 

1.1 

A 

1  &  3  "protozoa" 

1.1  gets  a  B  since  "protozoa" 

1.2 

A 

1 

is  not  directly  mentioned. 

1.3 

A 

1 

But  by  convention    3,  when  you 

score  Phrase  3  you  go  back  and 

change  1.1  to  A.    Then  by 

convention,  the  whole  thing 

1 .0  gets  an  A. 

37.3 

B 

1='  one-celled 

This  was  the  best  we  could  do 

organism" 

to  alve  person  credit  for 

/ 

knowing  that  protozoa  are  one- 

• 

celled  organism.    Person  gets 

a  B  not  A  for  37.3  because  "one- 

celled  organism:  Is  an  Inference 

from  "enclosed  in  a  single  cell. 

6.0 

B 

2 

Just;Concept  II  Is  explicit. 

6.1 

B 

2  - 

One  could  argue  that  the  rela- 

6.2 

B 

2 

tionship  of  example  is  pretty 

6.3 

A 

2 

explicit  but  I  wouldn't  agree. 

3.0 

B 

2 

Because  person  says  sporozoans 

5.0 

B 

2 

are  dealt  with  In  this  section. 

that  Implies  Relationship  3&5, 
but  we  can't  of  course  give 


credit  for  any  parts  of  these. 


Relation-     Score  ^    ^Phrase^lt  ^,»,nale 

Phrase  3  gets  represented  in  Relationship  1  and  in  fact  causes 
change  of  1 .IB  to  1  .lA  and     of  1.0  B  to  1.0  A 


57.0 

B 

4 

Relates  specifically  to  "they 
are  related  to  humans" 

57.1 

8 

4 

"Specialized  creature"  is 
rendered  as  "sporozoans"  or 
"they" 

57.2 

A 

4 

Property  relation  is  explicit 
in  "are" 

57.3 

B 

4 

"Direct  ancestor". . .  is 
rendered  as  are  related  to 
humans 

58.0 

B 

4&  5 

Because  again  "direct  ances- 

58.1 

B 

4  &  5 

tor*'...  1s  merely  Implied  In 

58.2 

A 

5 

"they  are  related  to  humans." 

\ 

58.3 

A 

5 

We  are  taking  the  author's 
use  of  unlikely  to  be  stylistic- 
and  "they  are  not"  to  be  a 
paraphrase. 

59.0 

B 

4 

Relates  to  "many  people 

believe  they  are  related  to  ^ 

humans" 

59.1 

B 

4 

Same  ST^ason  as  58.1 

A 

4 

Rplatlon  15  pxDllrlt 

59.3 

A 

4 

"Many  people  believe"  and 
"they  are  not"  are  seen  as 
close  paraphrase. 

60.0 

A 

4&  5 

The  two  phrases  are  In  con- 

60.1 

A 

4&  5 

trast  to.  each  other  explicit- 

60.2 

A 

4&  5 

ly  with  word  "although" 

60.3 

A 

4&  5 

ERIC 


XXX 


Annotated  Recall 

^Protozoans  are  one  celled  creatures. 
^Nervojis  and  digestive  systems  may 


Subject  if  =  082 


be  present.  ^ ^They  were  not  derived 
from  humans    **although  this  belief  is 
popular.    ^Their  name  Is  misleading  (first  animal) 
^as  they  are  very  complex  organisms  thus 
requiring  evolution.  ^They  have  no  cell 
walls  and    ®cells  division  is  very  similar 
to  animal  cell  division. 


Relation- 
ship 

Score 

Phl'Tse  it 

comes  from 

^  Rationale 

1.-1 

A 

T^'Trotozoans" 

By  convention  3  note  ^hat  this 
is  all  of  Relationship  1  that 
g^ts  scored 

37.3 

B 

l="one-cened 
creatures" 

Same  as  for  Subject  075 

33.3 

A 

2 

Person  doesn't  say  anything 

34.3 

A 

•  2 

about  these  systems -being 
"properties  of  specialized 
structures." 

57.0 
57.1 
57.2 
57.3 


C 
B 
A 
C 


3  &  4 


What  makes  this  whole  phrase 
Incorrect  (C)  1s  the  Implica- 
tion that  anyone  would  think 
that  protozoans  are  derived 
from  humans.    The  text  Implies  ^ 
the  other  way  around..  57.1  gets 
B  for  same  reason  as  Subject 
■075  ^ 


58.0 

3&4 

5.8.1 

,  c 

3&4 

58.2 

A 

3&4 

58.3 

A  ' 

3&  4 

Same^s  Relationship  57 
Same  as  Relationship  57.3 

Same  as^ for  58.3  for  Subject 
075 


Relation-     Score       Phrase  1t  Rationale 
shig  comes  from  ^  

59.0  C  3&4  Same  as  for  Relationship  57 

59.1  C  3&4  Same  as Torn?eT^ETons*f1p^ 

59.2  A  3&4  Close  paraphrase 

59.3  A  3&4  Close,  paraphrase 


60.0  ■  A  3&4  Same,  generally,  as  for  subject 

60.1  A  3&  4  075 
■^O.Z  A  ^3&4 

60.3  A  3&4 


24.0  A  5  "Their  name"  Is  stylistic  sub- 

24.1  A  stitutlon  for  "protozoa" 

24.2  A  Everything  else  Is  explicit. 

24.3  A  .  •  < 

25.0  A  5  Obvious- 

25.1  A 

25.2  A  ■ 

25.3  ■     A  .  . 
 -  -  -I-  

26.0  B  5  If  protozoa  "require  evolution" 

26.1  A  *  be  explained  then  they  must 

26.2  B  .  'v!!^^  evolved  but  this  Is  only 

26.3  B  Implied  and  the  fact  that  this 

Is  a  property  of  protozoa  Is 
also  Implied.  * 

27.0  A  6  Obvious 

27.1  A 

27.2  A 

27.3  A  • 

28.0  A  6»"Dhus  "Thus"  makes  causal  relation-. 

28.1  A  evomlon"  ^^^^  explicit.    The  two  concepts 

28.2  A  are  explicitly  mentioned. 

28.3  A  .  -  " 


Relation; 
ship 


18.1 
18.2 
18.3 


Score 


A- 
A 
A 
A 


Phrase  It 
comes  from 


Rationale 


T 


Obvious 


19.0 
19.1 
19.2 
19.3 


A 
A 
A 
A 


8 


Obvious 


Appendix  F  " 
Tables lOf  mean  proportion  scores  of  concepts  and 
relationship  parts  recalled  from  the  learning  study 
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•     ^Table  2  r 

BIOLOGY:    Mean  proportion  scores  for  relationship  parts  of  propositions 
identified  by  lev.el  and  explicitness 

1.    A-scores  (units  judged  to  be  explicitly  recalled) 

Explicitness**  ' 


Level  * 

 T 

Hi^h 

Low 

Total 


Impl  icit 

.115 
.110 
.113 


Explicit  ' 

.233 
.179 
.205 


Total 

.199 
.161  ■ 


*F  (1 .  863)  =  7.79,  p  =  .005  - 
**F  (1 ,  863)  =  35.52,  p  =  .001 
/    L^vel  X  Explicitness:    F  (1,  863}  =2.25,  p  =  .134 

2.    B-scores  (units  judged  to  be  impl icitly  or  partially  recalled) 


Explicitness** 


Level  * 

High 

Low 

Total 


Impl icit 

.115 
•  .084 
.101 

2.37,  p  =  .124 
49.60,  p  =  .001 


Explicit 

.040 
.034 
.037 


*F  (1  ,  863) 
**F  (1 ,  863) 

Level  X  Explicitness  F  (1  ,  863)  =  1  .94,  p  =  .165 


Total 

.0^1 
.047 


ERIC 


'     '         Table  3 
•    ■  '  '.•    ■      ■  '  ■     •  ■  •  .■     '  ' 

HISTORY:    Mean  proportion  scores  for  concepts  in  relationship  propositions 
'identified  by  level  and  explicitness 

1.  A-scores  (units  judged  to  be  explicitly  recalled) 

Explicitness**  _ 
Level*  Implicit  Explicit  Total 

High  .139  .195  .190 

■  Low  .142  .163  .163 
Total                         .139  .182 

*F  (1,  1154)  =  7.74,  p  •  .005 
**F  (1,  1154)  =  4.90,  p  =  .027 

Level  X  Explicitness:    F  (1,  1154)  =  .13,  p  =  .715  ^ 

2.  B-scores  (units  judged  to  be  implicitly  or  partially  recalled) 

Explicitness** 

Level*  Implicit    ,  Explicit^  Total 

.  High  .065  .059  '  .060 

Low  .155  .048  .049 

Total       ..  .071  ^  .054 

*F  (1  ,-  1154)  =  3.29,  p  =  .070 
**F  (1 ,  1154)  =  1  ,11 .  p  =  .293 

■  Level  X  Explicitness:    F  (1.  1154)  =4.50,  p  =  .034 
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.  Table  4         ■  • 

HISTORY:    Mean  proportion  scores  for  relationship  parts^n  propositions 
identified  by  level  and  explicitness 

1.  A-scofes  (ur|^its  judged  to  be  explicitly  recalled) 

Explicitness** 

Level  *  Impl icit  Explicit  Total 

High.  .096  .206  .160 

Low  .1  25  .149  .143 

Total  *  .1P5  .180 

♦F  (1 ,  575). =  3.92,  p  =  .048  . 
♦♦F  (1  ,  575)  =  28.4^  p  =  .001  <  . 

Level.  X  Explicitness:    F  (1  ,  575)  =  7.32,  p  =  .007 

2.  B-scores  (units  judged  to  be  impl icitly  or  partially  recalled) 

Expl  ici;tness** 

Level  *  Impl  i.cit  Expl  icit  Total 

High  •         .113  .057  .080 

Low  .104  *       .048  .063 

Total  .110  .053 

♦F  (1  ,  575)  =  .79,  p  =  .374 
♦♦F  (1 ,  575)  =31 .04,  p  =  .001 
Level  X  Explicitness:    F  (1,  575)  =  \00,  p  =  .99 


\ 
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Table  5 

BIOLOGY:    Mean  proportion   scores  for  concepts  in  relationship  propositions 
■        identified  by  embeddedness  and  relationship  type 

1.    A-scores  (explicit  recall)  2.    B-score  (implicit/partial  recall) 


LEVEL*  . 

LEVEL* 

Type^* 

High  Low 

Total 

High 

Low 

Total 

Def 

.488  .142 

.281 

.038 

.038 

.038 

Prop 

.215  .179 

.199 

.054 

.038 

.047 

Examp 

.179  .132 

.159 

.054 

.046 

.050 

Comp 

.142  .068 

.094 

.031 

.025 

.027 

Temp 

.128  .213 

.196 

.082 

.057 

.062 

CaQs  , 

.147  .135 

il40 

.095 

.078 

.085 

Total 

.201  .158 

.055 

.043 

*F  (1  .  1722)  =>  15.61 ,  p  = 

.001 

*F  (1 ,  1722) 

=  9.62,  p  = 

.002 

**F.  (5. 

1722)  =  9.31 ,  p  = 

-.001 

**F  (5,  1722) 

=  6.46,  p  = 

.001 

Type  X  Leivel  :    F  (5,  1722) 

=  5.48,  p  =  .001 

Type  X  Level : 

F  (5,  1722) 

=  .2 

p  =  .931 


Table  6 

BIOLOGY:    Mean  proportion  scores  for  relationship  parts  in  propositions 
Identified  by  embeddedness  and  relationship  type 

1.    A-scores  (explicit  recall)  2.    B-score  (implicit/partial  recall) 


LEVEL* 

LEVEL* 

Type** 

High 

Low 

•> 

Total 

High 

Low 

Total 

Def 

.373 

.132 

.236 

.145 

.057 

.095 

Prop 

.244 

.213 

.230 

.028 

.017 

.023 

Examp 

.110 

.049 

.084 

.134 

.124 

.130 

Comp 

.147 

.060 

.091 

.026 

.035 

.032 

Temp 

.086 

.229 

.200 

.132 

.057 

.072 

Caus 

.086 

.139 

.117 

.128 

.075 

.097 

Total 

.199 

.161 

.061 

.047 

*F  (1  ,  855)  =»  5.49, 

P  = 

.019 

*F  (1 ,  855)  = 

4.45,  p  = 

.035 

**F  (5,  855)  =•  16.41,  p  = 

.001 

**F  (5,  855)  = 

25.79,  p  = 

.001 

Type  X  Level:    F  (5,  855) 

=  3.03,  p  =  .Ollf 

Type  X  Level : 

F  (5,  855) 

=  1.4- 

p  =  .209 


Table  7 


HISTORY:    Mean  proportion  scores  for  concepts  in  relationship  propositions 
Identified  by  embeddedness  and  relationship  type 

1.    A-scores  (explicit  recall) 


\i 

LEVEL 

LEVEL* 

Type**\ 

High 

Low 

Total 

High 

Low 

Total 

Def  ' 

265 

21  5 

233 

054 

044 

Prop 

.207 

.148 

.]84 

.054 

044 

050 

Examp 

.169 

.136 

.159 

.0^9 

.061 

.073 

Comp 

.094 

.095 

.094 

.022 

.031 

.025 

Temp 

.230 

.223 

.226 

.034 

.024 

.029 

Caus 

.266 

.243 

.252 

.094 

.072 

.081 

Total 

.190 

.163 

1, 

.060 

.049 

*F  (1. 

1146)  = 

14.0,  p  = 

.001 

♦F  (1  ,  1146) 

=  3.94,  p  = 

.047 

♦♦F  (5. 

1146)  = 

10.94,  p  = 

.001 

♦♦F  (5,  1146) 

=  7.80,  p  = 

.001 

Type  X  Level  :  F 

(5,  1146) 

=  .66,  p  =  .653 

Type  X  Level : 

F  (5,  1146) 

=  .44, 

p  =  .822 


Table  8 


^^ISIORY:    Mean  proportion  scores  for  relationship  parts  in  propositions 
Identified  by  embeddedness  and  relationship  type 

1.    A-scores  (explicit  recall)  ^  2.    B-score  (implicit/partial  recall) 


LEVEL* 

LEVEL* 

Type** 

High 

Low 

Total 

High 

Low 

Total 

Def 

.163 

.031 

.080 

.117 

.176 

.154 

Prop 

.231 

.166 

.205 

.028 

.023 

.026 

Examp 

.067 

.061 

.065 

.164 

.131 

.154 

Comp 

.087 

.073 

.083 

.022 

.032 

.025 

Temp 

.167 

.171 

.169 

.075 

.068 

.072 

Caus 

.176 

.213 

.198 

.158 

.099 

.123 

Total 

.160 

.143 

•  080 

.063 

*F  (1 ,  567)  -  5.66, 

P  = 

.018 

*F  (1, 

567)  = 

2.61  ,  p  =» 

.107 

**F  (5, 

567)  =>  18.33,  p  = 

.001 

**F  (5, 

567)  = 

35.62,  p  = 

.001 

Type  X 

Level :    F  (5, 

567) 

»  1  .37,  p  =  .232 

Type  X 

Level : 

F  (5.  567) 

=  1.01 

p  =  .371 


Table  9 

% 

BIOLOGY:    Mean  proportion  scores  for  Concepts  In  relationship  propositions 
identified  by  explicitness  and  relationship  type 

\ 

1.    A-scores  (explicit  recall)  2.    B-score  (implicit/partial  recall) 


EXPLICITNESS* 

EXPLICITNESS* 

Type** 

Imp 

Exp 

Total 

Imp 

Exp 

Total 

Def 

.200 

.285 

.281 

.095 

.035 

.038 

Prop 

.190 

.199 

.199 

.076 

.045 

.047 

Examp 

.119 

.164 

.159 

* 

.075 

.047 

.050 

Comp 

.080 

.095 

.094' 

.023 

.027 

.027 

Temp 

.141 

.199 

.196 

.046 

.064 

.062 

Caus 

.025 

.144 

.140 

.058 

.086 

.085 

Total 

.148 

.182 

.068 

.047 

*F  (1. 

1722)  = 

1 .96,  p  = 

.161 

*F  (1, 

1722) 

=  6.60,  p  = 

.010 

**F  (5. 

1722)  = 

9.46,  p  =• 

.001 

**F  (5, 

1722) 

=  6.27,  p  = 

.001 

Type  X  Exp:    F  (5,  1722)  =- 

.31 ,  p  =  .905 

Type  X 

Exp: 

F  (5,  1722) 

=  .89, 

p  =  .491 


J 


I 


^  ^ 


Table  10 


BIOLOGY:    Mean  proportion  scores  for  relationship  parts  In  propositions 
Identified  by  expllcltness  and  relationship  type 

1.    A-scores  (explicit  recall)  2.  -^B-scores  (Implicit/partial  recall) 


EXPLICITNESS* 

^EXPLICITNESS 

«r  ' 

Type** 

Exp 

Total 

- 

Imp 

EX£ 

Total 

Def 

'  .040 

.297 

.236 

.172 

.071 

.095 

Prop 

.182 

.237 

.230 

.050 

.019 

.023 

Examp 

.056 

.126 

.084 

.153 

.094 

.130 

Comp 

.067 

.099 

.091 

.043 

.029 

.032 

Temp 

.206 

.190 

.200 

.077 

.062 

.072 

Caus 

.063 

.131 

.117 

.035 

.113 

.097 

Total 

.113 

.205 

.101 

.037 

> 

*F  (1  ,  855)  »  9.66,  p  =• 

.002 

*F  (1, 

855)  = 

10.18,  p  = 

.001 

**F  (5,  855)  '  11 

.93,  p  = 

.001 

**F  (5, 

855)  » 

16.89,  p  = 

.001 

Type  X  Exp:    F  (5,  855)  = 

1.06,  p  =  .381 

Type  X  Exp:  F 

(5,  855)  = 

2.57, 

0 


)     '   "   • 

Table  11 

HISTORY:    Mean  proportion  scores  for  concepts  in  relationship  propositions 
identified  by  explicitness  and  relationship  type 

1.    A-scores  (explicit  recall)  2.    B-scores  (implicit/partial  recall) 


EXPLICITNESS 

* 

EXPLICITNESS 

* 

Type** 

Imp 

Total 

Imp 

Exp 

Total 

Def 

0  ( 

^33 

.233 

0 

.044 

-.044 

Prof 

.147 

.186 

.1,84 

.029 

.051 

.050 

Examp 

.116 

.1  62 

.159 

.134 

.069 

.073 

Comp  ' 

.042 

.096 

.094 

0 

.026 

.025 

Temp 

0 

.226 

.Z26 

0 

.029 

.029 
.081 

Caus 

.235 

.253 

.252 

s. 

.154 

.077 

Total 

.139 

.182 

•\.071 

.054 

*F  (1 ,  1148)  =•  2.90,  p  =  .089  *F  (1  ,  1148)  =  1  .23,  p  =  .268 

**F  (5,  1148)  =  9.20,  p  =  .001  **F  (5,  1148)  =  7.78,  p  =  .001 

Type  X  Exp:    F  (5,  1148)  =  .04,  p  =  .991  Type  X  Exp:    F  (5,  1148)'=  4.69, 

p  =  .003 


PRir 


Tabt^  12 

HISTORY:    Mearf  proportion  scores  for  relationship  parts  in  propositions  identified 
by  explicitness  and  relationship  type  •  .  , 


1.  J  A-scores  (explicit  recall) 


2.    B-scores  (implicit/partial  recall) 


EXPLICITNESS 

* 

EXPLICITNESS 

* 

Typy* 

Imp 

f 

Exp 

Total 

I        ,  M 

r"  rx 

Eocp 

Total 

Def- 

.038 

.094 

.080 

;  .056 

.186 

.154 

Prop 

■  .14.3 

.217 

.205 

\  .039 

.024 

.026 

Examp 

.071 

.054 

.065  / 

.151 

.160 

.15"4 

Comp 

.()68 

.086 

.083 

.009 

.029 

.025 

Temp 

^  .122 

'  .234  ' 

.169 

.096 

.038 

.072 

Caus 

.190 

.206 

.198 

.126 

.120 

.123 

Total 

.105 

.180 

.110 

.053 

*F  (1 ,  567)  = 

5.12.  p  = 

.024'**'*' 

*F  (1  ,  567) 

=  .28,  p  =  . 

599 

**F  (5. 

556)  = 

12.88,  p  = 

.001 

**F  (5,  567) 

=  zi.eo,  p  = 

.001 

Type  X 

Exp:  F 

(5, 

567)  = 

1  .58,  p  =»  .164 

Type  X  Exp: 

F  (5,  567)  = 

1  .30, 

/ 


ERIC 


Appendix  G 


Individual  Subjects'  Ratings  of  the  Ease  of 
Resolution  and  the  Importance  of  Cohesive  Ties 

prefer  to  Section  III,  Part  4) 
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THE  CHANGE  TO  AN  ADULT  FROG  IS  AMAZING 
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Appendix^ H 

Graphs  of  Predictabil ity  Ratings  of  Topic  Continuity 
(refer  to  Section  III,  Part  4) 
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Appendix  I 
Importance  Rating  Sentences 
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666 


THE  STRUCTURES  OF  THE  SNAKE'S  HEAD 


no3-s 


^  esi 


I  8 


2  2 

2  1 

.  1  1 

1  2 

2  .1 
2  2 

2  1 

1  2 

1  1 

2  2 

1  1 

1  2 


tef  eh.  l«port«M:.„of  th.  ld..(.)  r.;,r..«.t.d  In  th.  following  .ent«c..  to  the 

Th«  rating  !■  on  •  6 -point 


1-2  3 
•xtrcMly  quit*  •OMwhmt 

tAlKportant     unimportant  unlBportant 


4 

•OMvhat 

ixportmnc 


5  . 
quice 
iKportanc 


Clrcl*  th*  nuiib.r  which  r«pr*«*nt»  your  rating. 


1.  Snakas  hava  taath  on  tha  lowar  Jaw. 

2.  The  anaka's.^ray  la  ayallowad  whola. 

3.  <:^«  naaal  cavltlaa  contain  olfactory  narva  endlnRa. 

4.  Tha  nmaal  cavity  la  tha  location  for  the  aenaa  of 

5.  Tha  tongua  raata  In  a  ahaath  on  tha  floor  of  the 
nouth.  ^ 

6.  Ou.t  and  odor-baarlng  partlclaa  from  tha  air  are 
pfckad  up  bcfora  balng  tranafarad.  to  tha 
Jacobaon*a  organa. 

7.  Tiny  pita  In  front  of  tha  roof  of  tha  mouth  are 
callad  Jacobaon'a  organ^. 

8.  An  cxampla  of  •  atructura  of  tha  anaka'a  head  are 
Ita  eyaa. 

9.  Each  aya  of  tha  anaka  la  covarad  by  a  tranaparant 
scale. 

10.  PupUa.ara  ahapad  differently  In  different  a;iakea; 
for  exaaple,  they  can  be  round. 

11.  The  aara  are  embedded  In  the  ekull. 

12.  The  eara  have  no  external  openlnga. 


extr . 

iininp. 
I 

1 

1 


extremely 

important 


extr. 
imp . 

5  •  6 


ERLC 


a 'J  7 


THt^REPRODUCTIVE  SYSTEM  OF  THE  FROG 


■ 

CM 


■  H 

CM  V 


$  a 

CI  H 
^  CI 


1  ,1 

t 

2  1 

1  2 

1  1 

2  2 
2  1 
1  2 


1  1 
1  2 


|AC«  th«  laporcanca  of  ch«  ld«a(a)  r«pr«««nc«d  In  ch«  foUowlnf  •«nt«nc««  to  the 
vhola  pMS«t«-  y  ' 

tli«  ratiof  U  on  4* -point  ccnU:  •  Z*^ 


1                     2  3                     *  5 

•xtrsMly            quits  acMuhat          soMvhat  qulta 

unimportant     imlJiportant  unlaportant  '    Important  laportwir 

Circle  thm  Duabar  utilch  r«pr«««titf  you|^  tlitliit-^ 


1.    Th«  sax  orsana  of  both  saxaa  ara  internal. 

Tha  thuaba  of  tha  nalaa  ara  anlarged  only  during 
tha  braading  saaaon.        '  . 

3.     The  Bale  raproductlve,  organe  ere  called  the  teetee," 

It,     The  teetee  lie  In  the'  back  In  the  anterior  region 
of  the  kidneys.  ^ 

5.     The  aperma  go  Into  the  kidneya  before  they  are 
diacherged. 

.6.    The  enlergaMnt  at  the  baae  of  eech  ureter  la 
celled  e  saalnel  veelcle. 

7,  The  proceeeea  in  the  male  reprodiictive  eyataia 
Involve  the  apem  developing  in  the  teetee »  then 
passing  through  ths  vass  sffsrsntis  into  the 
kidnWys,  uhsrs  thsy  srs  dischsrgad  through  the 
uTstsrs  Into  ths  closes.  ' 

8.  Ths  ovsriss  srs  locstsd  sbovs> ths  Jfdnsys. 

9»     Ths  famals  rsproductivs  ayataa  la  involved  |n  e 
nuaber  of  ptoceeeee  during  the  breeding  seeson. 


2    2     10-     The  ebdcmlnel  aueclee  work  the  egge  toward  Che 
entertor  which  ie  tfhere  they  ere  i^etKered. 

2    1     11.     The  oviduct  le  lined  with  clUeted  cells* 

2    2     12.    The  egge  go  into  the  oviduct  end  than  into  the 
•  •  cloace* 


erftr . 
unl^p  * 
.  1 


I 
1 


axcrcaaly 

important 


3 
3 

3 

3 

3 


2  r  3 


imp . 


6 


ERIC 


t  MUSCLE.  STRUCTURE    ^  ;#105-S 

A    ElACe  Che  imporcance  of  the  idea(8)  represented,  in  Che  following  senceaces  Co  Che 
S        whole  pusage.  *  .  . 

2>       .  The  racing  is  on  a6-polnC  scale: 

is  C  ■    ■  .  

at 

S   3  12  3  ^  4  5  6  . 

^   c     excrenely  qulce  eomewhac  somewhac  quice  ^excremely 

^        unlmporcanc     unimpprcanc    .  unlmporcanc       laposcanc        iaporcanc  Ispdrc^nc 

>   o.  Circle  the'  nuaber  which  represents  your  racing. 

extr.  extr . 

unimp.      .  imp. 

12       1«    Muscle*  structure  shows'  lt:self  In  striated  muscles.             1        2  3  4  5  6 

11        2»     Striated  muscles  are  composed  of  muscle  fibers.                  1       2  3  4  5  6 

11  3.    Muscle  fibers  are  elongated  cells.  12  3  4.56. 

12  4.     Striated  muscles  are  crossed  by  s,triations»                        1        2  3  4  '   5  6 

2    2       5.     Seeing  the  band^  under  an  ordinary  light  micro-  1        2        3        4       5  6 

scope  is  different  from  see il!%- them  under  an  >  ^ 

electron  microscope. 

2    2       6.     Seeing  the  bands  as  continuous  from  one  side  of  1        2       3       4       5  6 

the  fiber  to  another  is  different  from  seeing 
them  as  features  of  the  myofibrils. 

♦ 

2    2       7,    The  bands  that  appear  to  be  continuous  from  one  1.       2        3        4       5  6 

side  of  the  fiber  to  the  other  side  are  called 
A  bands. 

2    1       8.     The  }.\  bands  a,|:e  in  the  middle  of  the  A  bands.  1.      2        3^4       5  6 

2    1       9.     Myofibrils  are^very  closely? packed  together.  1  %  2        3        4       5  6 

2    1     10.     The  banding  iSf?^eterminecl  by  the  distribution  of  'V  ^        2        3        4       5  6 

the  materials  composing  it.  *  ' 

1     2  Striated  muscles  are  composed  of  sarcomeres.  1        2        3        4       5  '  6 

1     1     12.     Sarcomeres  is  the  term  for  the  material  between 
the  two  Z  bands. 


6S,9 


HOW  MUSCLES  WORK 


#106-U« 


A  S 


lAte  Che  laporcuice  of  the  ld«a(a)  represencied  In  the  following  sentences  to  Che 
ifhole  pasaa^e. 

Tha  racing  la  on  a6-jpolnc  acale: 


CI.  ^ 

>  & 

CI  K 

^  .  CI 


1  r 

1  1 

1  2 

1  1 

2  2 

1  2 

2  2 
2  2 
2  1 

1  2 


1  2  3  *      4  5 

axtrtMly  qulce  aowwhac  soacvhac  qulce 

unlnporcanc     uniaporcanc     unlmporcanc       imporcanc  imporcanc 

Clrcla  Cha  nunber  which  rapraaanca  your  racing. 

'     ^'         ■  excr., 
unimp. 

1.  The  acclon  of  muscles  resulcs  from  chemical  12 
"processes  wlchlri  Che  Individual  cells. 

2.  Muscular  energy  Is  cransfonned  Inco  mechanical  1  2 
energy  In  Che  form  of  moclon. 

3.  The  way  In  which  muscles  are  ^ble  Co  move  bones  12 
llluscraces  a  more  general  consideration  of  che 
relacionshlp  between  Che  anacomlcal  locaclon  of 

Che  muscle  accachmenc  and  Che  acclon  of  some 
muscles. 

A.    The  anacomlcal  locaclon  of  che  muscle  accachmencs  1  2 

allows  che  muscles  Co  be  able  Co  move  che  bones. 


5.  One  pare  of  che  muscle  Is  che  belly. 

6.  The  anacomlcal  locaclon  of  mosc  muscle  accach- 
mencs Is  the  perlosceum  of  che  bone. 

7.  The  most  common  accachmenc  Is  by  means  of  a 
cendon. 

8.  A  less  conmon  meatus  of  accachmenc  Is  by  a  she^c 
of  heavy  connecdve  c Issue. 

9.  The  placemencs  of  che  muscle  origins  bring 
abouc  che  movemenc  of  che  forearm  In  a 
verdcal  plane. 

10.    Knowing  che  origin  and  Inserclon  of  che  crlceps 
brachll  allows  ua  Co  underscand  che  movemenc 
made  possible  by  lea  acclon. 

\   2    1    11.    The  triceps  have  chree  origins  which  gives  ic  its 
name.    ^  ^ 

2    1    12.    Since  both  the  biceps  and  triceps  Have  several 
points  of  attachment*  complex       Ion  Is 
possible. 


extremely 
important 


2^ 


ext  r . 
imp . 
6 


670 
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R  C 


$  a. 


1  1 

1  2 

1  1 

*2  1 


SKELETAL•^nJSCLES  WORK  IN  PAIRS 


#107.U 


Race  cha  laporcanca  of  cha  Idaa(a)  repreaented  In  the  following  sentences  to  the 
vfaola  passage* 

Tha  rating  la  on  a6^polnc  acale: 


extremely 
uninportant 


2 

qtiite 
unifflportant 


aontwhat 

unimportant 


4 

aomavhat 

important 


5 

quite 
important 


Circle  Cha  nuabar  which  rapreaanca  your  rating. 


1.  An  iaportant  muscle  characterlatlc  Is  that 
skeletal  tmacles  work  In  pal ra. 

2.  Skelstfll  muscles  working  In  pairs,  are  antag- 
onistic muscles  that  cauaa  oppoalng  actlona. 

3.  Antagonistic  muscles  cauae  oppoalng  action. 

A.    Each  muscular  contraction  cauaas  motion  In  one 
direction. 


extr» 
unlmp. 
1  2 


1  2 
1  2 


extremely 
important 


ext  r . 
imp. 

A        5  6 


3  A  5  6 
3       4        3  6 


2    2       ^*  *  muacular  contraction  causes  motion  In  one 

direction,  s  muscle  contraction  of  the  other 
member  of  tha  pair  cauaes  motion  In  the  opposite 
direction. 


2  2 

2  1 

1  1 

1  2 

2  1 
2  2 


10. 
11. 


The  contraction  of  the  blcepa  muacle  la  an  example 
of  the  action  of  bleeps  and  trlcapa. 

Contraction  of  the  biceps  muscle  cauaes  the  arm  to 
flax  at  tha  elbow. 

The  machanlan  by  which  contractions  of  antago-  ^ 
nlatlc  muaclea  are  , controlled  by  tha  central 
nervpua  ayatem  la  not  clearly  undaratood. 

How  contractions  af  antagoniatlc  muaclea  ara 
controlled  by  the  central  narvoua  aystsm  appeara 
to  ba  by  a  procaaa  In  which  tha  contraction  of  a 
muacle  stimulatss  nervs  cslls  which  send  s  volley 
of  nsrvous  impulses. 

The  volley  of  nsrvous  impulaas  from  nerve  cells 
goes  to  ths  central  narvoua  ayatem. 

A  property  bf  tha  volley  of  narvoua  impulaes  Is 
that  It  prevents  ths  muscls  from  contracting 
rather  than  caualng  It  to  relax. 


12        3       4        3  6 


1       2        3       4        3  6 


1        2        3       4        3  6 


1        2        3       4        3  6 


1       2       3       4       3  6 


1       2        3       4        3  6 


■ 

CM 


H 
■ 


CLASS  CHONDRICHTHYES 
CARTILAGE  PISHE^  ^ 
Rate  the  laportance  of  the  idea(s)  repreeentcd  in  the  following  sentences  to  the 
whole  passage* 

Tha  rating  la  on  a6-polnt  scale: 


> 


1/1 

CI 


a. 

H 


2  1 


2  2 


1  2  3  A  5 

extremely  quite  so««what  somewhat  quite 

unimportant     unimportnit     unimportant       Important  important 

Circle  the  number  which  represents  your  rating. 


1.  An  example  of  the  clasa*  chondrichthyes ,  is  sharks 

2.  Becauae  sharka  have  certain  differences, 
placed  in  a  separate  claas. 

3.  The  long  upper  lobe  cauaes  the  shark *^  head  to  go 
down* 

4.  The  shark's  mouth  is  a  horizontal  si 
3.    The  jaws'  of  most  aharks  are  lined  w^^ 

6.  When  a  shark  loses  a  tooth,  another  moves  forwaf 
to  replace  it. 

7.  The  shark  is  a  fearsome  hunter  because  its  teeth 
slant  backwards  and  thus  can  hold  food  securely 
in  its  mouth. 


(ixtremely  ^ 
Important 


3 
3 


excr . 
Imp . 
6 


12  8.  The  respiratory  process  of  the  shark  involves  water 
entering  the  mouth,  passing  the  gills,  before  being 
forced  out  through  separate  pairs  of  gill  slits. 

2  1  9.  The  shark's  gills  are  located  on  either  side  of  the 
head. 

]     ]    10.     Sharks  have  eyes. 


6  72' 


f 

2  ^ 

(X 
i  X 
CM  t> 

JZ 


t  2 


STRUCTURES  OF  THE  TRUNK  AND  TAIL 


flll-S 


Race  th«  laporcaiice  of  ch«  id«a(s)  represented  in  the  folloirlng  sentences  Co  che 
vfaole  peeeege. 

...    The  racing  le  on  e6-poinC  scale: 


c     1  2  3  4  5 

ezcrenely  soncvhac  sonewhac  quite 

unlaporcant     unlnporcanc     imixaporcanc       Inporcanc  Important 

Circle  Che  nuaber  which  repreeenca  your  racing. 

extr, 
unlmp . 

1.     Fins  are  an  example  of  structures  of  the  trunk  1  4 

and  call. 


excremely 
Important 


ext  r 
imp 

5  ;  6 


1  1        2.     Pins  differ  In  form  from  species  to  species.           ^  1       2  3  It  5  '  6 

2  1        3.    The  spiny  rays  are  compoeed  of  cartilage.  1       2  3  4  5  6 

2    1        4.    The  sharp  spines  Chat  are  raised  toward  the  head  12  3  4  3  6 
make  It  hard  for  Che  fish  to  be  swallowed  tall  first. 


11        5,    One  example  of  a  single  finals  the  anal  fin. 

2    2  The  anterior  dorsal  fin  of  the  perch  exemplifies 

anterior  dorsal  fins  In  fish.  '> 

-  >  / 

2    1        7.    The  anterior  dorsal  fin  of  the  perch  contains 

sharp  spines. 

2    2       8.     Because  the  sharp  spines  are  raised  toward  the  head 
making  the  fish  hard  tp  be  swallowed  tall  first, 
they  act  as  a  defense  against  atCack. 


12       9.    An  example  of  muscles  In  the  trunk  and  tall  can  be 
found  In  the  region  of  the  trunk  above  the  spinal 
column. 


I  2     10.    One  example  of  the  strucCures  of  the  lateral  line 

under  the  scales  Is  the  nerve  endings. 

II  11.    The  lateral  line  acts  as  a  sense  organ. 


I!  7  3 


t 


FU6ELLATES 


m4.u 


i 

CM 


JZ 


tMtm  thm  Inporcanctt  of  Cha  Idtta(s)  r«pres«nced  In  the  follcwing  sentences  to  the 
ffhole  pAssagtt. 

Tht  racing  la  on  •  6-polnt  •cmlar 


unlsportant 


2 

qulCtt 

unisporcanc 


3 

soiMvhac 
uniiiporcanc 


•oMfhat 
important 


5 

quite 
inportant 


> 


1 

1 

1 
2 
2 

1 

2 

1 

1 
2 

2 
2 


CI 


Circle  the  niniber  which  raprasante  your  racing. 


1  I.     Flagellates  have  long  been  a  biological  battle- 

ground. 

2  2.    We  recognize  that  some  flagelletes  are  indeed 

plants. 

1  3.    Euglene  are  related  to  green  algae. 

2  ^.    Green  algae  store  starch. 

1  3.    When  Euglena  is  kept  in  the  dark  or  treated  with 

streptomycin,  it  loses  chlorophyll. 

2  6.    Still  other  flagellates  seem  to  belong  to  both 

kingdoms »  as  for  example  the  Khawklnia. 

1  7.    The  Chilomonaa  consumes  its  prey  whole  as  all 

animals  do. 

2  8.    That  some  flagellates  seem  to  belong  to  both 

kingdoms  leads  to  considering  them  as  a  welter  of 
varied  f  lege  Hates. 

1  9.    Bio'logists  disagree  as  to  where  they  should  draw 

the  line  between  plants  and  animals. 

2  10.    AnSsxaople  of  the  relationship  shown  by  these 

rese^lances  is  thet  some  flegellates  are  similar 
t(v^he  emeba. 

2  II.    When  they  lose  their  flagella,  soma  flagellates  move 
by  maens  of  flowing  protoplaem. 

1  12.    The. protospongia  is  similar  to  the  collar  cells  of 
sponges. 


extr . 
unimp . 
1  2 


axtremaly 
important 


\  3 


cxcr . 
Imp . 

6 
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tHE  LINNAEAN  SYSTEM 


#n5-u 


8  .. 


at 

•  s 


£  S 


1  1 

1  2 

2  2 

2  1 

1  T 

2  2 
2  T 

2  1 


Bacs  th«  Isportanca  of  th«  id««(«)  reprssented  In  th«  following  ■encences  to  the 

Tha  rating  la  on  a  6 -point  acmle: 


1  2  3  4*  5 

aztraaely  quita  aoMwhat  aoaavhat  quita 

unlaportmnc     unimportant     imlnportant       laportant  important 


Clrcla  thi  numbar  vhlcb  rapraaanta  your  rating. 


!•    The  Llnnaean  System  uses  binomial  classification. 

2*    Tha  binomial  claaaification  ayat«in  involves  rulea 
for  naming  new  apaciea. 

3.  An  axample  of  the  two  things  that  a  acientiat 
ffluat  do  when  ha  firat  identifiea  a  nev  species  is 
to  publish  a  deacription  of  it  in  a  recognized 
Journal.  ^ 

4.  The  acientist  muat  depoait  an  original  specimen  In 
some  collection  where  othera  can  atudy  it. 

5.  We  still  uae  the  baaic  ayatem  but  we  look  at  it 
differently. 

6.  Species  that  become  extinct  are  different  from 
species  that  change  into  one  or  more  new  species. 

7.  Becauae  the  change  in  apeciea  ia  gradual ,  It  is 
hard  to  decide  when    the  species  have  drifted 
far  enough  apart  to  be  callad  aeparata  species. 

i- 

8.  Whethar  organiaos  atill  balong  togather  is  an 
exazDple  of  an  iaaua  that  biologiata  oftan  diaagree 
about. 


extr. 
unimp . 

1  2 


axtramaly 

important 


extr, 

imp . 
6 


2    2      9.    Groupa  of  organiama  that  hava  driftad  far  enough 
apart  to  be  called  aeparata  apaciaa  are  different 
from  thoae  that  atill  balong  together. 

1    2     10.    An  example  of  Linnaaua*  uae  of  hia  own  ayatam  is 
.that  ha  ragardad  apaciaa  aa  fixed  and  unchanging. 

]  Z  11.  That  a  apaciaa  ia  a  population  which  alwaya  ahares 
conaidarabla  natural  vacianca  ia  an  axample  of  how 
we  viav  tha  baaic  ayatafli. 

1     1     12.    A  apaciaa  waa  rapraaantad  by  tha  type    of  apaciman 
dapoaitad  in  a  muaaum  and  variationa  from  the 
typa  ware  ragardad  almoat  aa  nuiaancaa. 


ERIC 


a  7  5 


CHIEF  ARGUMENTS  FOR  AND  AGAINST  SLAVERY 


#217.S 


<^    lAtt  th«  laportancc  of  cht  ldta(«)  rcprc«eoced  in  the  following  acntencta  to  the 


CM 


t€ 
€> 
■ 


Tht  racing  la  on  a  6 -point  acala: 


2  1  2  3  4  5 

^     axtraaaly  quita  MOMvhac  aoaewhat  quite 

unisportanc     uniiiporcant     imlaportant       ixoportant  inrportanc 


> 


Clrela  (ha  nuabar  which  rapraaanca  your  racing. 


1.  The  chief  artiumencs  for  and  agalnsc  slavery  did  not 
change  much  for  100  yean. 

2.  The  arguments  for  slavery  were  presented  by  Malachy 
Postlechwayt . 

3.  An  example  of  an  argument  for  slavery  im  that  slaves 
made  money  for  slaveowners. 

U.     An  example  of  argumenta  against  slavery  was  that  It 
fV    was  evil  to  make  money  from  slaves. 

5.  ^Slaves  were  property  and  property  coul^ lot  be  taken 

away  — — 

6.  To  say  that  no  human  being  could  be  property  is  si- 
milar to  saying  that  no  man  has  the  right  to  own 
another  man. 


cxt  r . 
unimp . 

1. 


extramaly 
Important 


evil 

I  mi. 


2    2         7t     That  It  was  wrong^  to~say  that  a  slave  was  Jusc  another      12  3^56 
kind  of  property  Illustrates  the/ belief  that  no  human 
being  could  be  property,  no  man  has  the  right  to  own 
another  man. 

2    2         8.     Slaves  still  had  the  right  to  freedom,  ms  do  al3  mizn  12        3        4        5  6 

and  it  mattered  little  how  well  a  maater  treated  his 
a lave . 

11         9.  ^  The  slavea  had  a  right  to  freedom  aa  do  all  men.  1        2,3       ^        5  6 

2     1  *    10.     To  say  that  the  slavea  were  better  off  than  they  12  3^56 

had  Been  in  Africa  ia  different  from  saying  that 
alavea  still  had  a  right  to  fraadora  aa  do  all  men. 

2     1        11.     The  soula  of  the  black  men,  women  and  childran  would  12        3        4        5  6 

be  saved  no  mat  tar  what  happaned  to  their  bodies  on 
earth. 


2     1        12.     The'argumant  of  convarting  mlrnvmrn  to  Christianity 
vaa  vary  deferent  from  tha  argument  that  it  was 
nonaenaa  to  say  we  wera  halpihg  the  slaves  by  making 
tham  Chriatiana. 


9  • 


%       '  \         WHY  BLACKS  HAD  UHLE  HOPE  IN  1857  #218-U  . 

ch«  laporcanca  of  ch«  ld«a(s)  r«prM«nt«d  in  ch«  follovlng  ••ncencas  Co  che 
o        vhol«  pusags. 

Th«  rating  is  on  a  6 -point  scale: 
3 


i 

CM 

i 

Ok 

M 

• 

1 

U 

> 

& 

1  2 

1  2 

2  2 

2  2 

1  1 

1  1 

2  1 

1  2 

2  2 

2  1 

2  1 

1  1 


1  2  3  4  5 

•ztraaly  quitr  aoaavhat  aoaawhat  qulta 

uniaportant     uninportant     uniaportant       iaportant  laportant 


Cirda  tha  nuabar  vhlch  rapraaanta  jkhsix  rating. 


1.  ^An  axaaple  of  why  blacks  had  licde  hop«  In  1657 

vat  chair  life  In  che  Norch. 

2.  In  che  Norch  moic  whlce  people  could  noc  forgec 
chec  each  freedman  had  once  been  a  ileve. 

3.  An  exainple  of  che  llccle  equallcy  evelleble  In 
che  Norch  la  chac  there  were  few  plecei  where 
bleck  men  could  hope  co  vote. 

^>    Anocher  exanple  of  little  equality  li  thee  chere 
were  few  pieces  where  e  bleclc  man  could  hope  co 
find  e  good  job. 

5.  In  che  Souch,  ilevery  wet  scronger  Chan  ever. 

6.  In  che  growing  Unlced  Scecei,  new  iceces  were 
forming. 

7.  There  were  few  pieces  where  e  bleck  man  could 
hope  CO  give  hli  children  en  educecion  equel 
CO  chec  of  whlce  children. 

6.     The  growing  Unlced  Scecei  ellowed  for  ch^ 
■preed  of  ilevery.  ^ 

9.     An  example  of  e  Norchem  pollclcien  !■  Scephen 
Douglaa. 

10.  Scephen  Douglas  vea  e  lenacor  from  Illinois. 

r 

11.  Scephan  Douglaa  leid  thee  ilevery  should  be 
ellovad  in  any  new  icece  where  whice  cicizeni 
waSced  Ic. 

12.  The  Dred  Scocc  declalon  would  lead  co  e  decision 
ebouc  many  ocher  queaciona. 


excr . 

unlinp . 
1  2 


extremely 
Important 


ext  r . 
Imp . 


f)?7 
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WESTERN  CATTLE  INDUSTRY  IN  1890'S 


#219-U 


CSJ  CI 

■ 


tMtm  thm  Ixporcanct  of  thm  Idia(a)  r«prQa«nc«d  In  thm  follcwlng  aentencea  to  the 
vhoU  pM««g«. 

Thm  racing  la  on  ■  6 -point  acalt: 


>  & 

CI  K 
CI 


1  1 

1  1 

1  1 

2  2„ 
2  1 

1  2 

2  2 

1  2 

2  1 

1  2 

2  2 
2  1 


1  2  3  A  5 

•ztmely  qultt  aoMvluic  aoacvhac  quite 

unisportant     uniaportant      uninportant       Isportant    ^  laportant 


Cirda  the  nuabar  which  rapraaanta  jomv  rating. 


1.  The  western  cattle  Induatry  centered  In  the  high 
plains  by  the  X890'a. 

2.  Moac  ranchers  by  now  owned  their  grazing  land  and 
fenced  It  with  barbed  wire. 

3.  The  alze  of  a  grazing  area  dependa  upon  the  amount 
of  rain. 

4.  Weatem  ranchaa  seetnad  anormoua  to  eaatenersp  who 
by  contrast  were  accustooad  to  sntall  fsrms. 


5. 


Esstemsrs  were  sccustomed  to  smell  farms  of  not 
more  than  a  ^ew  hundred  acrea.  * 


6.  The  western  cattle  Industry  of  1890  was  influenced 
by  the  availability  of  water. 

7.  Because  of  the  Improvement  of  windmills  for  pumping 
water*  many  cattle  ralaera  watered  their  stock  from 
wella. 

8.  The  years  of  abundant  rainfall  cauaed  graaa  to  grow. 

9.  Fattened  herda  cauaed  the  rancher  to  proaper. 

10.  An  example  of  tha  Influence  of  ^tha  availability  of 
water  la  that  yeara  of  drought  would  cauae  no  natu- 
ral graaaaa  to  grow*  which  In  turn  would  force  the 
ranchera  to  feed  cattle  hay  or  cottonaeed  cake, 
thua  wiping  out  thalr  proflta. 

11.  Tha  abaanaa  of  natural  graaaaa  forced  the  ranchers 
to  faad  cattle  hay  or  cotton  aead  cake. 

12*    Feeding  catt)L^  hay  and  cotton  aeed  cake  was  a  costly 
practice.  V 


extr , 
unimp . 
1  2 


extremely 
important 


ext  r 

imp 
6 


0 
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THE  SHERMAN  ANTITRUST  ACT 


#220-U 


■  K 

CM  O 


MMf  thm  l«porc<nc«  of  tha  id«a(t)  r«pr«s«nc«d  in  Ch«  following  aaQCttncat  co  the 
vhols  pMsags. 

Th«  racing  is  on  a6--poinc  seals: 


>  cx 

CI  H 


szcrc^lr 


/ 


qulcs 


soMvhac 


sowvhac 

inporcsnt 


5 

qulcs 
Inporcanc 


unisporcsnc     unlaporcsnc  unlnporcanc 

Ci^ds  chs  nuabsr  which  rsprsssncs  your  racing 


2  1 
2  2 


'1.     Tha  Shennan  ancltruac  act  finally  pasaed  In  1890. 

2.  What  cha  public  aaaumad  the  act  would  do  was  to 
braak  up  giant  tn^ta  and  thereby  restore  a  larger 
msaaure  of  fraa  competition. 

3.  Ths  tarn  truat  had  corns  to  mean  a  monopoly  or  near 
monopoly  of  the  bualnaaa. 

4.  What  public  eaeuaed  the  act  waa  about  was  almllar 
to  what  congresa  Intended. 

**  i 

5.  An  example  of  the  waakntreaea  of  the  act  is  that  few 
Americans  understood  pr^claely  what  .the  new  law  did 
and  did  not  prohibj 

6.  kn  exampla^^oL^e  weakneaaes  of  the  act    is  that  it 

was  extremely  difficult  to  enforce. 

7.  The  government  lost  7  out  of  the  flrat  8  caaes. 

8.  That  the  goverment  loat  7  out  of  the  first^  cases 
lllustrstss  thst  the  set  wss  extremely  dlffucult  to 
enforce . 


extr. 

unimp . 

X 


sxcreoely 
important 


c  K  t;  r . 
Imp . 


2    2  9.    The  act  being  extremely  difficult  to  enforce,  led  Co 

a  Supreme  Court  decialon. 

2  1  10.  The  Supreme  Court  decided  the  company'a  control  over 
refining  didn't  raatraln  Intaratata  trade  and  there- 
fore found  the  company  not  guilty. 

2  *2         11.    A  monopoly  Itaslf  was  not  illegal  but  it  waa  illegal 
^^ly  whan  it  reatrainsd;  intaratata  trade. 

2    1         12.    The  Supreme  Court  dsciaion  waa  that  mi/llDpoliaa  are 
illegal  only  whan  they  restrain  intaratata  trade. 


ERIC 


.1 


\ 


JOHN  0.  ROCXEFaLER 


#222-S) 


■ 


c  I 

i  ? 

1  1 

1  2 

2  2 
ir  1 
2  2 

2  2 

1  2 

1  1 

2  1 

1  2 

2  1 

1  1 


Asc«  Ch«  lapqrtAaca  of  tha  id«A(^)  rtprM«ic«d  in  tha  following  ■■ntancea  to  tha 


Th«  racing  la  on  4f6-*point  acala: 


tmlsporcanc 


2 

quica 

unlxportmc 


■  GMWtlAC 

imlMportant 


5 

quica 
iaporcant 


1. 
2. 

3. 
4. 
5. 

6. 

7. 

8. 

9.. 

10. 
11. 
12. 


Circle  tha  mabsr  which  represents  your  rating. 


Evan  richar  than  Camagi*  John  0.  Rockefellar 

Rockafallar  atartad  Ufa  aa  a  poor  boy  and  latar 
•tfCtoulatad  tha  worlds  graataat  fortiina.  ^ 

Rockafallar  vorkad^aa  a  dark  *baf ore  1958. 

In  1895  Rockafallar  yfiia  19  yaar«  old. 


Aftar  1958  tha  ciyil  w«r  brought  large  profit*  to 
tha  bualnaaa. 


5afora  Rockefallar  Invaatad  In  ol 

civil  w«r  brought  large  profit!  to 


l(Vtp.nterla8 
o  hi*  buaine 


buaines* . 


Ha  brought  order  and  efficiency  to  the  oil  industry , 
hi*  aajor  Intereet.  ^ 

Oil  becana  hi*  aajor  intereet  befoij^  1900, 

Ha  aold  the  Greet  Laka  Steaaara  to  U.  S.  Sceel  Cor- 
poretion.  a 

An  exaapla  thet  hie  intereete  hed  broedened  ia  thet 
he  ovnad  controlling  atock  in  iron  ore. 

The'^nited  Stetee  Steel  Corporetion    vae  being 
organized  by  J.  P.  Morgen. 

Like  Cemegie  Rockefeller  leter  geve  «vey  naii^  nil- 
1  ^ona . 


excr . 
unifop, 

i 


ascreiMlx^ 
important 


2^^ 
2 


3 

3 

3 
3 


5 
5 

5 
5 
5 

k  5 
i  5 

V  ' 

k  5 
4  5 


Imp . 

6 
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the' NEW  DEAL  FARM  PROGRAM  .  #223-U^ 

BACe  Che  iaporcance  of  the  lde«j[s)  represented  In  the  following  sentences  to  the 
whole  passage. 

The  rating  la  on  a" 6 -point  scale: 


extremely 
unimportant 


2 

quite 
unlisportant 


somewhat 

unimportant 


^'omMiat 
important 


5 

quite 
important 


extremely 
Important. 


1  1 
1  2 

1  2 

2  2 

2  1 

2-  1 
2  2 

1  1 

2  2 

1  1 

1  2 

2  1 


Circle  the  number  which' represents  your  rating. 


1.  A  disaster  struck  the  Great  Plains.  ' 

2.  Farm  practices  lead  to  the  disaster^ 

3.  When-^high  prifces  tempted  farmers^to  grow  wheat 
and  cotton,  plows  and  har^rows  broke  up  the  sod. 

4.  Because  the  years  were  unusually  dry,*there  was 
a  danger  that  the  region  would  become  a  desert. 

5.  It  wa^  terrible  that  dust  storms  carried  away 
toosoil .  . 

6.  The  sun  was  obscured  by  a. ye  How  haze. 

•  ♦  »  ^  ! 

7.  After  unusually  dry  years,  the  water  table  sank 
causing  deep  wells  to  run  dry. 

8.  It  was  estimated  that  350,000  farmers  emigrated 
from  the  dust  bowl  between.  1934  and  1939. 

9.  Departnent  of  Agriculture  helped  farmers  plant 
trees-  in  order  to  cut  wind  velocity. 

10.  The  New  Deal  farm  prbgram  ^suf fered  much  criticism. 

11.  A  criticism  of  the  New  Deal  farm  program  i^^as  that- 
benefits  of  the  AAA  were  unequal,. 

12.  Hundreds  of  .thousjands  of  families  were  saved  from 
bleak  despair  and  poverty. 


•xcr. 

unlmpv 
1 


2 

2 
2 

2 

2 

2 
2 

2 

2 

2 
2 


3 
3 
3 

3 

3 

3 
3 

3 

3 

3 
3 


4 

4 
4 

4 

4 

4 

4 

4 
4 


5 

5 
5 

5 

5 

5 
5 

5 

5 

5 
5 


extr. 

Imp'* 
6 

6 

6 


6 

6 

6 
6 

6 

6 

6 
6 


r  ' 


6'8J 
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•  X 
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CI 


>  & 
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DUST  BOWL 


#223-U 


tiate  tht  laportance  of  th«  idca(s)  represented  in  the  following  sentences  to  the 
wfable  passage. 


•xtreaely 
unlaportant 


The  rating  Is  on  a  6 -point  scale: 

2  3  4 

quite  soBcvhat  ^  somewhat 

unlaportant     unimportant      -  important 


5 

quite 
Important 


Cirela  cha  number  which  represents  your  rating: 


1    "I      1.  A  disaster  struck  the  Great  Plains. 

1  2      2.  Farm  practices  leari  to  the  disaster. 

12      3-  h^^^  prices  tempted  farmers  to  grow  wheat 

and  co^tton,  plows  and  harrows  broke  up  the  sod. 

2  2  Because  the  years  were  unusually  dry,  there  r.ad 

a  danger  that  the  region  would  become  a  desert. 

2    1      5.  It  was  terrible  that  dust  storms  carried  away  • 
topsoil.  - 

n 

2    1      6.  The  sun  was  obscured  by  a  yellov,*  haze.* 

2    2      7.  After  unusually  dry  years,  the  water  table  sank 
causing  deep  wells  to  run  dry. 

1  ]      8.  It  was  estimated.  350,000  farisers  emigrated  from 

the  dust  blow  between  193^  and  1939.  ^ 

2  2  Department  of  Agriculture  heli^ed  farmers  plant 


1  1 

1  2 

2  1 


extr . 
unlmp. 


trees  in  order  to  cut  wind  veloci.ty. 

10.  The  New  Deal  farm  program  suffered  much  criticlsn.  .  1 

11.  A  criticism  of  the  New  Deal  farm  program  was  that 
benefits  of  the  AAA  were  unequal.  1 

12.  Hundrediof  thousands  of  families  were  saved*fron 
bleak  despair  and  poverty.  1 


,6  . 
extremely 
important 


2 

,  2 

2 
2 


extr. 
imp. 
5  6 


5  .  6 
•5  6. 

•fit  y. 

5  6 
5  6 

f 


ERIC 


THE  FIRST  PHASE  OF  THE  NEJH  DEAL 


#225-3 


^  <^  lAt«  th«  laportanee  of  ch«  idea<s)  represented  in  the  folloving  sentences  to  the 
o 


6  •«  vhole  pessege. 

X 


The  rating  is  on  s  6 -point  scale : 


€1 

■  e 


H 

1  2 

1  .  1 
2,  2 

2  1 
2  2 

1  2 

1  1 

2  1 
1  1 

1  2 

2  2 
2  1 


extremely 
uniaportant 


2  3  A  5  6 

quite  sosewhat  somewhat  quite  extremely 

uniiiportant     unimportant       important         important  important 

Circle  the  number  which  ripresents  your  rating. 


1.    During  the  first  phase  of  the  New  Deal* 

Roosevelt  had  no  very  clear  Idea  of  how  to  deal 
with  economic  crisis. 


extr. 
unlmp . 
1 


2.  Roosevelt  vas  not  dismayed  that  he  had  no  very  1 
clear  Idea  of  how  to  deal  with  economic  crisis. 

3.  He  signed  Bome  lawa  In  order  to  avoid  holding  up  1 
legislation . 

A.    His  philosophy  was  "try  aomethlng*'.  1 

3.    He  felt  action  was  better  than  Inaction;  for  X 
example »  he  saw  himself  as  a  quarterback  on  a 
footbafl  team. 

6.  The  New  Deal  was  not  a  carefully  worked  out 'program  1 
because  Roosevelt  did  not  have  a  clear  Idea  of  how 

to  <^eal  with  economic  crisis.  .  . 

7.  Unlike  ot^er  carefully  worked  out  programs »  the  1 
New  Deal  was  not  ca|^fully  worked  out. 

8.  Alexander  Hamilton's  program  was  proposed  during  1 
the  Washington  Administration. 

9.  An  example  of  a  carefully  worked  out  program  was  1 
that  of  Wbpdrow  Wilson. 

10.  The  New  Deal  had  some  measures  embodying  long-  1 
standing  demands  for  change  that  would  have  been 
enacted  sooner ; or  later.  ^ 

11.  Congreas  repealed  the  Volstead  Act  before  passing  1 
the  Twenty-First  Amendment.  — -H- 

12.  The  Twenty-Flrat  Amendment  repealed  the  prohibition  .  '  '1 
amendment  once  and  for  all. 


extr. 
imp .. 

6 


ERLC 
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THE  AMERICAN  ECONOMY  WAS  CLOSE- TO  ROCK  BOTTOM 


#226-S 


■ 

CM 


■ 

«4 


BAt«  th«  iMportuce  of  th«  ld«a(s)  represented  In  the  following  sentences  to  the 
whole  peeeege* 

if        '  ■  ■ 

*  The  reting  Is  on  e6«-polnt  scele: 


2 


e 


o. 

«l 


2 
1 
2 
2 

Is 

1 

2 : 

2 

1 
1 
1 

2 


1  2  3  4  5 

extreoely  quite  somcwhet  sonewhet  quite 

uninportsnt      uniiaportant     uniziportent       inportent  importent 

Circle  the  nuaber  which  represents  your  reting. 

♦  extr. 

unlmp , 

1.  »The  American  economy  ves  close  t6  rock  bottom  .   X  2 
es  exemplified  by  conditions  In  eveVy  lerge^  city. 

2.  A  80ng»  "Brother  can  you  spare  me  a  dime",  reflected 
the  frequency  of  begging. 

3.  Dwindling  tax  repelpts  cnused  local  government  to 
go  near  bankruptcy. 

A.    Firefighters  were  among  those  employees  not  paid 
for  months  at  a  time. 

3.    The  depression  had  Its  harshest  effiects  on  those/ 
who  could  least  bear  It. 

\}  ■  f 

6.    Farmers*  Income  fell  more  rapidly.  12 

,  7.  .  An  example  of  people  who  could  bear  the  depression  1  2 

better  were  owners  of  stocks  and  bonds. 

8.  People  with  fixed  Incomes,  for  Instance,  could  , 
bear  the  depression  better. 

9.  Among  those  who  had  fixed  incomes  were  college: 
*  professors. 

10.  For  those  with  fixed  Incomes,  the  fact  that  prices 
dropped  actually  caused  them  to  be  better  off ^ 

11.  The  bottom  dropped  out  on  the  new  car  market,  but 
enough  people  managed  toehold  onto  old  ones. 

12.  An  example  of ^ the  depression  being  dheven  In  Its 
impact  was  the  fact  that  cigarette  sales  rose 
steadily. 


extremely 
important 


extr , 
imp , 


k  5 

4  5 

4  5 

^  3 

4'  5 

k  5 

4  5 

4  5 


es4 

ERJC  , 


^  <^    tmtm  thm  laportncc  of  thm 


,  EFFECTS  ON  MILLIONS  OF  YpUNG  AMERICANS  #227-S 
)  reprM«nted  In  ch«  follovliig  aencences  Co  Che 


CM  CI 

■ 


Thm  rating  is  on  «  6-poinc  scale: 


•  s 


€1  H 


1  2 

1  2 

1  1 

1  1 

2  J 
2  1 

2  2 

2  2 

2  1 

1  1 

2  2 
1  2 


imlxportant 


2 

quite 
unlsportent 


3 

•oamiiat 

unlaportut 


A 

flowwhec 

laportenc 


5 

quite 
Important 


drcla  the  maiber  ufalch  represents  your  rating. 


1.  An  effect  of  the  Depression  on  millions  of  young 
Americans  waa  the  lack  of  clothing. 

2.  During  the  Depreaalon»  the  youth  faced  unemploy- 
ment after  graduating  fron  school. 

3.  Two  agencies  were  created  that  brought  Immediate 
relief  to  the  nation *a  youth. 

4.  One  of  the  New  Deal  work  relief  measures  was  Che 
Civilian  Conservation  Corps. 

5.  Work  canps^were  scattered  across  the  country. 

■J 

6.  Young  men  were  Expected  to  share  the  wages  chat 
they  were  paid  with  their  famlllea. 

7.  Helping  to  conserve  the  nation 'a  natural 
resources  was  socially  useful  work. 

8.  One  way  . that  young  men  helped  to  conserve  the 
nation 'a  natural  reeourcea  was  by  clearing  awampa. 

9.  Young  men  cleared  land  for  public  parks. 

10.  The  NYA  distributed  Federal  money  to  needy 
atudenta. 

11.  Youth  performed  taska  In  and  arotind  their  achoole 
before  being  paid  regular  wagea. 

\t 

12.  The  New  Deal  work  relief  measures  saved  hundreds 
of  thousanda  of  youtha  from  Idleneea. 


extr . 
unlmp. 
1  2 


extremely 
Important 


extr. 

imp. 
6 
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1 
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ROOSEVELT* S  FINANCIAL  POLICIES  #229-U 

tAtm  thm  laporcAnce  of  tkm  ldM(9)  r«pr«««nt«d  la  th«  following  sentances  to  the 
vhols  pM««t*> 

thm  rmtint  li  on  «  6 -point  tCAle: 


i  i 

1  2 

2  2 

1  1 
1  2 

1  1 

1  2 

2  1 

1  1 

2  2 
2  1 
2  /2 
2  1 


1  2  3  4  5 

•xtrcMly  quits  •OMwh«t  soMvh«t  quite 

unlnportant     unlaportmnt     unlniportmnt       Inportmnt  Inportmnt 


extremely 
Importent 


Circle  Che  nuaber  which  represents  your  rstlnt- 


e: 

un 


1.  Roosevelt's  flnsnclsl  policies  were  psrt  of  the 
New  Deal. 

2.  Roosevelt's  opposition  becaiie  sore  outspoken  sfter 
the  return  of  better  tines*  , 

3.  Three  methode  were  used  to  flnence  programs. 

4.  One  of  the  Inflstlon  measures  was  Congress 
authorizing  FDR  to  print  paper  money. 

5.  Deficit  spending  Is  defined  as  the  government 
spending  more  than  It  receives  In  taxee. 

6.  Deficit  spending  Increased  the  national  debt. 

7.  Bualneaa  leadera  In  particular  loat  confidence 
in  the  admlnlatratlon  becauae  It  piled  up  a 
larger  national  debt. 

8.  Ralalng  taxea  waa  another  method  uaed  by  the  New 
Deal  to  finance  operatlona. 

9.  Crltlca  calling  the  Revenue  Act  of  1935  a  **sbak 

the  rich  propoaal"  preceded  Ita  paaalng  by  Congreaa. 

10.  Congreaa  paaaed  the  Revenue  Act  of  1935  which  waa 
often  called  the  Wealth  Tax  Act. 

11.  Not  balancing  the  budget  cauaed  the  national 
debt  to  continue  to  grow. 

12.  The  taxea  obtained  revenue  but  thla  did  not 
balance  the  budget. 


tr. 
mp. 


extr. 

imp . 
6 


6  ' 


